-- Logs begin at Thu 2022-10-27 12:46:36 UTC, end at Thu 2022-10-27 13:43:18 UTC. -- Oct 27 13:15:02.911160 dv-cinder-862432-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 13:15:02.919941 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 13:15:02 2022] *** Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: nodename: dv-cinder-862432-3-iscsi Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: machine: x86_64 Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: clock source: unix Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: pcre jit disabled Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: detected number of CPU cores: 4 Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: current working directory: / Oct 27 13:15:02.921929 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: detected binary path: /usr/bin/uwsgi-core Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: your processes number limit is 47680 Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: your memory page size is 4096 bytes Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: detected max file descriptor number: 2048 Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: lock engine: pthread robust mutexes Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: thunder lock: enabled Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 13:15:02.922641 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 13:15:02.961666 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: Python main interpreter initialized at 0x55be5cb889c0 Oct 27 13:15:02.961666 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: python threads support enabled Oct 27 13:15:02.961666 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: your server socket listen backlog is limited to 100 connections Oct 27 13:15:02.961666 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: your mercy for graceful operations on workers is 90 seconds Oct 27 13:15:02.961990 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 13:15:02.962074 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: *** Operational MODE: preforking *** Oct 27 13:15:02.962316 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: *** uWSGI is running in multiple interpreter mode *** Oct 27 13:15:02.962316 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: spawned uWSGI master process (pid: 103715) Oct 27 13:15:02.962487 dv-cinder-862432-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 13:15:02.965267 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: spawned uWSGI worker 1 (pid: 103716, cores: 1) Oct 27 13:15:02.965267 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: spawned uWSGI worker 2 (pid: 103717, cores: 1) Oct 27 13:15:02.965267 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 13:15:03.618964 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 13:15:03.619630 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 13:15:04.696800 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:15:04.696800 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: from cryptography.utils import int_from_bytes Oct 27 13:15:04.697373 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:15:04.697373 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: from cryptography.utils import int_from_bytes Oct 27 13:15:04.697745 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:15:04.697745 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Oct 27 13:15:04.698152 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:15:04.698152 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: from cryptography.utils import int_from_bytes Oct 27 13:15:07.200625 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:15:07.201259 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:15:07.201358 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:15:07.201671 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:15:07.202033 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:15:07.202121 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:15:07.202200 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:15:07.202332 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.202447 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:15:07.202656 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.202805 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:15:07.202975 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.203064 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:15:07.203296 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.203430 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.203625 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.203752 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.203934 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204071 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204274 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204592 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204744 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.204919 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205053 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205178 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205371 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205492 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205687 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.205816 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-3-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206014 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206137 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206273 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206440 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206587 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206749 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.206910 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-3-iscsi {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207064 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207229 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207365 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207535 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207686 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207843 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.207987 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.208159 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.208484 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.208571 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.208807 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.208946 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.209111 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.209253 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.209564 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.209648 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.209902 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210029 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210203 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210293 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210509 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210603 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210826 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.210913 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211133 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211265 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211435 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211527 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211750 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.211832 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212055 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212138 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-3-iscsi {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212402 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212494 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212710 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.212796 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213072 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213158 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-3-iscsi {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213402 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213487 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213711 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.213798 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.214019 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.214106 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.214387 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.214485 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.214756 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.215356 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.215583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.215681 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.215913 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216052 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216251 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216340 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216562 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216664 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216883 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.216976 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217184 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217270 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217490 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217577 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217798 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.217902 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218097 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218191 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218404 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218497 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218708 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218794 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.218953 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219039 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219257 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219345 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219576 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219671 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219836 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.219922 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220139 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220288 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220481 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220569 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220730 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.220824 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221048 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221147 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221338 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221424 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221586 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221675 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221904 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.221991 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222223 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222310 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222527 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222611 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222828 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.222914 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223129 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223220 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223429 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223513 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223730 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.223823 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224030 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224115 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224354 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224500 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224686 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224772 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.224961 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225058 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225276 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225598 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225684 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225902 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.225998 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226207 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226303 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226548 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226634 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226836 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.226923 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227141 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227234 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227466 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227550 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227786 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.227899 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228091 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228191 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228423 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228510 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228729 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.228814 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229034 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229121 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229339 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229425 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229644 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229731 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229890 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.229977 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.230190 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.230315 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.230583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.230673 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.230903 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231025 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231203 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231296 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231503 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231590 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231806 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.231899 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232105 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232201 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232436 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232537 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232738 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.232822 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233035 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233121 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233444 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233641 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233726 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.233941 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234025 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234241 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234336 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234541 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234633 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234842 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.234925 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235139 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235233 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235443 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235540 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235744 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.235837 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236044 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236144 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236369 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236469 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236674 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236762 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.236976 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237074 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237277 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237363 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237579 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237673 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237879 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.237977 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238194 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238281 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238495 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238580 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238794 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.238894 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239106 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239192 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239407 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239493 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239708 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.239805 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240021 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240106 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240341 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240478 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240643 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240737 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.240956 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241041 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241252 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241351 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241553 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241640 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241854 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.241941 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242154 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242241 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242453 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242549 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242753 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.242844 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243051 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243143 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243349 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243434 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243644 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243729 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.243943 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244037 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244250 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244339 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244556 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244642 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244873 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.244974 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245177 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245263 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245487 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245572 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245791 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.245886 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.246157 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.246248 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.246477 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:15:07.246567 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.246801 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.246895 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247131 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247215 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247458 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247542 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247775 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.247863 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248087 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248174 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248435 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248522 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248751 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.248839 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249058 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249143 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249462 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249678 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.249988 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250079 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250300 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250398 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250605 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250707 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.250913 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251001 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251225 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251323 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251542 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251636 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251851 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.251944 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252163 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252308 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252513 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252608 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252823 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.252911 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253130 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253223 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253455 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253541 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253776 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.253862 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254089 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254184 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254414 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254498 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254734 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.254827 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255043 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255139 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255351 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255438 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255660 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255746 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.255972 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.256065 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.256376 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.256467 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.256692 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.256781 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257010 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257096 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257320 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257406 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257636 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257720 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.257944 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258030 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258253 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258561 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258647 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258869 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.258955 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259175 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259267 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259481 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259565 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259792 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.259879 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260100 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260192 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260436 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260535 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260746 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.260835 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.261305 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.261440 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262143 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262247 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262454 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262542 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262763 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.262850 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263066 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263164 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263367 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263455 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263667 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263753 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.263968 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264061 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264286 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264374 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264592 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264677 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264903 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.264990 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265206 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265298 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265526 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265612 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265827 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.265913 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266136 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266233 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266444 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266530 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266751 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.266839 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267054 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267141 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267359 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267450 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267666 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267752 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.267967 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268052 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268303 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268407 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268613 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268707 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268914 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.268999 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269231 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269325 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269533 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269618 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269835 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.269920 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270144 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270237 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270446 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270539 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270751 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.270836 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271061 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271154 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271489 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271676 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271768 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.271985 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272072 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272315 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272415 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272640 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272724 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.272957 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273046 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273258 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273342 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273670 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273909 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.273995 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274215 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274300 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274513 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274597 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274819 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.274908 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275122 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275212 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275426 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275529 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275728 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.275816 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276028 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276149 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276351 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276450 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276655 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276739 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.276955 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.277039 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.277308 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.277914 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278127 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278261 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278433 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278519 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278737 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.278839 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279038 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279122 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279344 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279437 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279647 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279735 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.279948 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280032 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280271 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280364 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280580 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280669 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.280924 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281011 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281232 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281318 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281558 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281645 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281871 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.281958 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282186 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282272 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282494 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282582 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282803 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.282896 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283112 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283198 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283422 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283509 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283733 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.283831 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284044 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284139 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284381 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284481 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284692 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.284779 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285001 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285133 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285310 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285437 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285619 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285705 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.285920 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286015 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286235 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286329 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286552 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286645 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286859 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.286953 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287176 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287270 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287494 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287578 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287804 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.287891 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288115 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288201 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288449 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288539 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288756 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.288845 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289064 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289153 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289371 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289463 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289683 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289777 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.289987 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290072 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290294 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290378 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290600 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290686 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290910 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.290995 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291217 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291316 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291524 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291610 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291823 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.291909 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292136 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292310 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292475 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292568 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292779 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.292865 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293124 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293223 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293452 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293540 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293769 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.293854 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294081 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294176 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294389 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294472 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294695 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294781 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.294999 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295095 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295302 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295400 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295609 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295693 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295912 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.295999 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296247 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296378 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296541 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296628 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296845 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.296934 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297151 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297247 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297454 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297549 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297756 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.297853 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298055 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298140 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298362 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298449 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298662 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298748 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.298960 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299052 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299267 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299586 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299672 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299888 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.299974 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300189 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300331 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300532 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300619 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300834 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.300920 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301132 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301226 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301435 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301521 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301734 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.301821 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302035 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302130 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302342 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302429 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302646 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302733 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.302954 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303047 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303270 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303358 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303569 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303655 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303885 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.303975 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304189 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304291 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304522 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304608 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304834 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.304931 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305142 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305227 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305450 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305534 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305753 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.305842 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306060 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306146 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306366 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306503 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306668 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306753 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.306974 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307061 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307280 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307373 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307588 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307680 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307890 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.307976 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308190 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308332 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308542 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308631 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308851 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.308945 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.309154 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.309414 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.309501 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.309751 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.309838 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310070 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310306 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310395 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310640 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310727 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.310955 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311051 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311275 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311363 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311624 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311720 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.311943 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312031 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312271 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312360 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312586 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312686 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312892 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.312988 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313198 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313292 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313507 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313594 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313809 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.313896 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314114 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314200 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314417 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314509 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314717 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.314802 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315019 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315104 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315321 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315445 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315624 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315742 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.315925 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316010 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316257 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316360 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316558 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316650 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316859 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.316956 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317160 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317254 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317463 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317554 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317773 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.317867 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318075 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318160 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318379 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318467 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318683 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318786 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.318982 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319067 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319286 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319381 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319589 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319684 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.319931 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320024 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320253 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320342 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320593 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320681 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320895 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.320983 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321223 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321311 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321531 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321619 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321834 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.321918 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322135 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322219 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322445 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322534 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322747 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.322831 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323046 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323138 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323353 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323440 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323657 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323743 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.323970 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.324618 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.324812 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.324902 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325120 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325205 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325439 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325537 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325732 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.325831 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326030 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326131 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326336 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326433 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326636 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326721 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.326936 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327021 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327243 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327337 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327545 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327639 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327842 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.327927 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328150 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328283 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328477 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328563 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328778 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.328875 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329081 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329168 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329380 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329474 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329681 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.329983 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330068 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330286 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330371 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330587 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330673 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330896 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.330984 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331201 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331287 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331503 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331597 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331806 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.331893 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332113 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332199 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332443 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332543 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332746 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.332846 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333053 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333145 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333358 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333454 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333663 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333749 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.333964 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334049 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334273 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334372 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334580 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334667 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334880 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.334967 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335179 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335265 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335481 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335566 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335781 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.335868 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336081 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336170 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336410 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336499 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336713 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.336798 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337017 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337110 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337319 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337405 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337621 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337707 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.337924 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338011 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338229 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338317 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338529 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338625 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338832 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.338918 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.339138 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.339224 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.339438 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.339533 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.340371 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.340466 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.340691 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.340776 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341010 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341105 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341323 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341417 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341727 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.341946 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342041 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342249 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342336 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342558 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342643 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342864 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.342950 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343167 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343253 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343467 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343551 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343769 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.343857 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344078 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344164 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344409 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344498 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344715 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.344803 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345037 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345130 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345349 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345436 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345661 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345748 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.345966 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346051 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346276 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346586 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346673 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346894 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.346981 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347198 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347295 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347501 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347586 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347806 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.347892 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348112 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348210 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348448 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348537 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348754 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.348851 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349060 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349154 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349365 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349452 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349671 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349757 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.349975 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350071 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350274 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350359 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350582 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350680 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350888 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.350974 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351187 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351271 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351491 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351576 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351795 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.351890 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352093 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352178 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352442 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352530 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352748 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.352899 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353056 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353211 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353360 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353787 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.353875 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354098 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354184 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354406 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354502 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354711 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.354798 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355019 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355104 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355381 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355479 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355745 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.355832 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356061 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356149 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356388 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356491 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356746 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.356838 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357049 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357139 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357349 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357658 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357746 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.357980 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358067 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358281 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358580 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358664 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358881 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.358972 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359200 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359289 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359501 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359600 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359806 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.359893 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360128 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360215 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360471 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360558 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360792 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.360880 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361211 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361306 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361521 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361606 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361825 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.361918 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362146 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362232 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362468 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362579 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362792 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.362880 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363097 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363193 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363409 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363495 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363715 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.363801 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364038 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364133 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364375 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364476 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364686 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364771 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.364996 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365091 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365299 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365393 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365615 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365701 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.365928 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366027 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366234 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366320 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366552 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366637 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366871 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.366958 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367185 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367274 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367507 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367600 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367904 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.367995 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368243 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368344 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368555 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368642 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368856 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.368947 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369163 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369249 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369464 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369559 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369765 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.369851 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370074 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370160 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370375 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370468 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370678 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.370763 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371007 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371093 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371316 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371410 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371616 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371708 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.371918 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372005 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372223 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372332 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372553 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372653 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372857 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.372944 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373174 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373475 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373560 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373797 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.373885 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374099 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374185 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374422 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374508 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374726 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.374812 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375028 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375117 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375330 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375417 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375632 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375719 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.375933 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376019 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376359 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376561 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376651 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376902 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.376990 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377204 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377298 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377524 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377619 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377854 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.377941 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378176 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378261 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378489 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378584 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378794 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.378880 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379109 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379195 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379433 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379528 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379737 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.379823 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380038 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380125 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380468 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380671 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380759 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.380974 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381074 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381275 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381363 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381574 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381659 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381871 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.381957 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382170 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382257 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382468 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382571 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382769 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.382857 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383072 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383160 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383375 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383462 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383683 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383776 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.383986 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384072 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384333 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384422 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384643 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384742 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.384948 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385035 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385251 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385338 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385553 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385652 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385891 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.385976 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.386448 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.386535 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387283 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387382 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387591 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387678 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387901 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.387998 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388214 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388326 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388548 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388859 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.388947 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389173 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389265 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389479 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389565 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389791 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.389883 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390102 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390188 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390411 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390498 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390727 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.390927 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391045 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391254 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391354 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391567 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391873 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.391960 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392179 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392315 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392518 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392616 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392831 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.392928 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393143 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393232 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393453 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393541 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393763 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.393859 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394074 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394162 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394384 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394470 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394698 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.394800 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395012 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395107 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395426 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395656 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395749 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.395973 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396060 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396311 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396420 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396626 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396719 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.396943 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397029 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397260 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397463 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397559 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397638 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397872 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.397960 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398186 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398286 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398498 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398586 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398810 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.398904 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399121 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399224 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399431 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399516 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399740 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.399826 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400047 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400134 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400384 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400475 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400694 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.400794 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401003 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401091 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401311 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401399 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401625 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401721 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.401939 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.402025 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.402799 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.402906 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403119 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403216 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403433 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403521 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403752 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.403954 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.404068 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.404292 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.404419 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.404633 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.404938 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405025 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405257 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405345 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405582 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405668 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405899 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.405986 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406221 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406315 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406526 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406650 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406833 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.406930 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407145 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407235 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407451 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407536 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407751 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.407845 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408059 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408147 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408389 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408479 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408693 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.408791 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409013 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409100 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409320 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409406 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409622 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409844 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.409933 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.410185 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.410272 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.410500 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.410748 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.410844 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411090 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411176 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411404 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411492 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411725 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.411822 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412047 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412135 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412373 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412463 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412679 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412766 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.412991 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413083 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413294 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413379 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413595 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413681 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413897 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.413985 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414204 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414290 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414597 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414812 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.414898 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415116 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415201 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415418 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415519 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415718 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.415812 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416029 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416125 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416353 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416454 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416658 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416797 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.416968 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417063 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417268 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417356 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417569 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417663 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.417920 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418023 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418224 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418310 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418526 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418618 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418825 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.418920 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419125 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419211 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419426 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419519 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419729 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.419816 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420037 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420123 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420363 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420453 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420675 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.420764 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421004 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421090 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421309 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421396 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421612 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421701 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.421929 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422023 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422230 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422316 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422535 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422630 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422848 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.422940 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423156 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423250 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423480 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423573 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423794 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.423881 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.424102 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.424346 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.424477 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.424681 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.424779 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425008 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425308 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425404 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425643 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425730 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.425953 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426040 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426260 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426357 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426566 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426653 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426890 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.426979 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427192 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427280 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427497 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427803 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.427891 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428112 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428201 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428444 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428530 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428752 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.428838 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429060 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429150 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429366 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429453 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429670 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429770 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.429975 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430061 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430280 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430373 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430585 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430679 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430889 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.430975 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431194 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431279 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431500 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431595 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431806 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.431892 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432111 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432198 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432451 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432541 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432764 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.432851 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.433077 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.433209 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.433387 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434016 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434237 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434327 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434547 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434633 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434854 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.434942 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435164 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435250 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435473 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435560 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435783 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.435871 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.436084 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.436170 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.436440 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.436756 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.436843 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.437063 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.437156 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.437383 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.437709 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.437854 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438023 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438109 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438343 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438439 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438665 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438760 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.438975 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439061 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439297 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439384 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439609 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439701 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.439918 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440003 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440277 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440574 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440662 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440904 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.440991 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441208 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441303 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441514 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441602 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441818 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.441906 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442128 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442224 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442446 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442533 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442749 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.442844 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443049 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443143 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443353 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443441 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443661 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443746 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.443961 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444055 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444284 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444374 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444590 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444677 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444893 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.444996 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445197 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445284 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445499 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445593 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445801 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.445887 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446101 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446188 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446399 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446485 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446698 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.446999 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447084 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447301 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447431 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447601 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447689 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447901 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.447988 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448201 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448374 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448526 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448614 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448824 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.448910 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.449696 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.449804 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450023 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450109 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450327 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450414 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450691 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450796 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.450957 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451047 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451277 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451368 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451687 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451900 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.451993 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452219 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452325 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452550 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452648 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452856 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.452942 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453177 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453262 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453484 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453578 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453792 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.453877 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454099 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454185 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454409 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454505 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454715 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.454801 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455021 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455108 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455328 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455415 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455636 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455730 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.455946 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456041 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456286 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456378 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456604 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456692 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.456908 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457072 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457223 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457311 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457533 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457620 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457848 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.457942 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458159 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458244 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458467 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458561 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458777 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.458866 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459084 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459175 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459390 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459475 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459702 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.459789 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460009 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460102 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460339 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460427 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460655 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460753 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.460962 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461091 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461271 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461583 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461671 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.461893 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462015 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462219 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462318 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462541 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462627 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462849 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.462934 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463175 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463272 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463501 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463587 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463829 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.463915 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464141 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464277 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464476 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464565 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.464904 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.465058 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103717) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:15:07.465147 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.465453 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.465759 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:15:07.466003 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103716) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:15:07.617250 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Registered counter for database nova_api Oct 27 13:15:07.618698 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Registered counter for database nova_api Oct 27 13:15:07.640166 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.641867 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.647276 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.648403 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.704678 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.context [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce8722d1-aebc-456c-be32-911a0277d16a(cell1) {{(pid=103717) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:15:07.705410 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.context [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce8722d1-aebc-456c-be32-911a0277d16a(cell1) {{(pid=103716) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:15:07.708554 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:15:07.709033 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:15:07.709253 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:15:07.709725 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:15:07.710624 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:15:07.711310 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:15:07.711453 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:15:07.711775 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:15:07.712029 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:15:07.712502 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:15:07.713814 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:15:07.714501 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_concurrency.lockutils [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103716) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:15:07.715814 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Registered counter for database nova_cell0 Oct 27 13:15:07.716543 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Registered counter for database nova_cell0 Oct 27 13:15:07.719903 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Registered counter for database nova_cell1 Oct 27 13:15:07.720695 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Registered counter for database nova_cell1 Oct 27 13:15:07.726933 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.728547 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.731765 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.731946 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.733332 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.735590 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.872428 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.873893 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.882457 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO dbcounter [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Registered counter for database nova_cell0 Oct 27 13:15:07.882583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO dbcounter [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Registered counter for database nova_cell0 Oct 27 13:15:07.891520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_db.sqlalchemy.engines [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103717) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.894999 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG oslo_db.sqlalchemy.engines [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103716) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:15:07.896206 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writer thread running {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:07.899752 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writer thread running {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:15:08.232353 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:15:08.235538 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:15:08.239541 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:15:08.242739 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:15:08.581568 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:15:08.587873 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: WARNING keystonemiddleware.auth_token [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:15:08.588337 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:15:08.593770 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be5cb889c0 pid: 103717 (default app) Oct 27 13:15:08.594868 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: WARNING keystonemiddleware.auth_token [None req-b34f2be7-58ad-48a7-93be-1fc1b1020ea4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:15:08.595824 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:15:08.597036 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] 10.222.0.48 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001750 Oct 27 13:15:08.597448 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 1/1] 10.222.0.48 () {50 vars in 788 bytes} [Thu Oct 27 13:15:08 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:15:08.600133 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55be5cb889c0 pid: 103716 (default app) Oct 27 13:16:29.299574 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:29.300548 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Oct 27 13:16:29.300952 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 2/2] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:29.317805 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:29.318916 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell0:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:29.319636 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell1:SELECT=3 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:29.320540 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:30.217329 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-3716dbaa-63f0-4807-9e63-ad12c3f3086f admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:30.249612 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-3716dbaa-63f0-4807-9e63-ad12c3f3086f admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.941826 Oct 27 13:16:30.250359 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 1/3] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Oct 27 13:16:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:32.926688 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:32.927685 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ac71a9f3-2ed1-46ec-8b80-e4954fef88e0 None None] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001967 Oct 27 13:16:32.928098 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 3/4] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:33.361003 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e358a2ed-433f-424a-9d38-6eebb8c59a37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "cirros256", "ram": 256, "os-flavor-access:is_public": true}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:33.409941 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e358a2ed-433f-424a-9d38-6eebb8c59a37 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.475778 Oct 27 13:16:33.411108 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 2/5] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:16:33.424711 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.425537 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell1:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.427756 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=3 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.428533 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:16:33.634888 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-2401b1aa-65a0-422e-a240-0f6e512b977a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:33.702154 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-2401b1aa-65a0-422e-a240-0f6e512b977a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282565 Oct 27 13:16:33.702742 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 4/6] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Oct 27 13:16:33 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:36.305516 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-e358a2ed-433f-424a-9d38-6eebb8c59a37 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:36.306539 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-e358a2ed-433f-424a-9d38-6eebb8c59a37 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001499 Oct 27 13:16:36.306964 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 3/7] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:36.938098 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ce91fe1b-0ac8-4136-9da7-c39a59988309 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "ds512M", "id": "d1", "ram": 512}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:36.980983 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ce91fe1b-0ac8-4136-9da7-c39a59988309 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.667487 Oct 27 13:16:36.981793 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 5/8] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:36 2022] POST /compute/v2.1/flavors => generated 404 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:16:36.994092 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-3cf52aef-0123-4f37-8f99-be5e93fefcd2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:37.032977 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-3cf52aef-0123-4f37-8f99-be5e93fefcd2 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042507 Oct 27 13:16:37.033561 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 4/9] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Oct 27 13:16:36 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:39.636049 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-ce91fe1b-0ac8-4136-9da7-c39a59988309 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:39.637117 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-ce91fe1b-0ac8-4136-9da7-c39a59988309 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Oct 27 13:16:39.637522 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 6/10] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:40.050348 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-a239a9b9-0d3e-4e85-bc73-5f0d48267383 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds1G", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 1024, "disk": 10, "id": "d2", "swap": 0}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:40.070603 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-a239a9b9-0d3e-4e85-bc73-5f0d48267383 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427083 Oct 27 13:16:40.071148 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 5/11] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:16:40.084102 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-8fb8e6b7-59d1-4625-8930-a160b4e03943 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:40.112905 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-8fb8e6b7-59d1-4625-8930-a160b4e03943 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032896 Oct 27 13:16:40.113260 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 7/12] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Oct 27 13:16:40 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:42.723749 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-a239a9b9-0d3e-4e85-bc73-5f0d48267383 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:42.724801 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-a239a9b9-0d3e-4e85-bc73-5f0d48267383 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Oct 27 13:16:42.725195 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 6/13] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:43.125767 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-0445e009-a619-49be-9c04-10e50b1544e1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 10, "name": "ds2G", "swap": 0}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:43.144953 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-0445e009-a619-49be-9c04-10e50b1544e1 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.413656 Oct 27 13:16:43.145631 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 8/14] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:16:43.157382 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-bfd3ffa7-3861-4bf0-b9dd-30ce546cc835 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:43.186179 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-bfd3ffa7-3861-4bf0-b9dd-30ce546cc835 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032348 Oct 27 13:16:43.186951 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 7/15] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Oct 27 13:16:43 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:16:45.770060 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-0445e009-a619-49be-9c04-10e50b1544e1 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:45.771110 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-0445e009-a619-49be-9c04-10e50b1544e1 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Oct 27 13:16:45.771685 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 9/16] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:46.174359 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "disk": 20, "os-flavor-access:is_public": true, "id": "d4", "name": "ds4G", "rxtx_factor": 1.0, "vcpus": 4, "swap": 0}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:46.197801 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.419601 Oct 27 13:16:46.198581 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 8/17] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:16:46.212776 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-053817dc-1cf8-499c-8bb4-e2fc2f06156f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:46.238967 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-053817dc-1cf8-499c-8bb4-e2fc2f06156f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029821 Oct 27 13:16:46.239542 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 10/18] 10.222.0.48 () {64 vars in 1336 bytes} [Thu Oct 27 13:16:46 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:48.851459 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:48.852548 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001573 Oct 27 13:16:48.853055 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 9/19] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:49.270650 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-15719276-be2e-49e6-ac26-997f71bbc6c8 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:49.302222 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-15719276-be2e-49e6-ac26-997f71bbc6c8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.442762 Oct 27 13:16:49.302971 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 11/20] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Oct 27 13:16:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:16:51.946404 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:51.947429 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-874a5b5e-5c21-4769-bde6-b96d33e8d797 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 27 13:16:51.947838 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 10/21] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:52.342983 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-427afe98-856b-48db-a657-8f2b9e4d4b19 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "disk": 1, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:52.364915 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-427afe98-856b-48db-a657-8f2b9e4d4b19 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.410908 Oct 27 13:16:52.365755 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 12/22] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:51 2022] POST /compute/v2.1/flavors => generated 402 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:16:52.378222 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-d4a49686-0b3e-4248-b891-5316dccfc5a8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:52.405892 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-d4a49686-0b3e-4248-b891-5316dccfc5a8 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031934 Oct 27 13:16:52.406460 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 11/23] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Oct 27 13:16:52 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:16:55.003452 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-427afe98-856b-48db-a657-8f2b9e4d4b19 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:55.005140 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-427afe98-856b-48db-a657-8f2b9e4d4b19 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002674 Oct 27 13:16:55.011548 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 13/24] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:55 2022] GET /compute/v2.1 => generated 388 bytes in 10 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:55.409862 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9707676a-189a-440b-9fb3-f59616ee43d6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "os-flavor-access:is_public": true, "id": "2", "rxtx_factor": 1.0, "disk": 20, "name": "m1.small", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:55.429325 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-9707676a-189a-440b-9fb3-f59616ee43d6 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.416211 Oct 27 13:16:55.429956 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 12/25] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:16:55.442003 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-9e4b71b7-dbaa-4037-ad69-20a48c7a9b41 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:55.465414 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-9e4b71b7-dbaa-4037-ad69-20a48c7a9b41 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027045 Oct 27 13:16:55.465992 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 14/26] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Oct 27 13:16:55 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:16:58.096402 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9707676a-189a-440b-9fb3-f59616ee43d6 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:16:58.097988 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-9707676a-189a-440b-9fb3-f59616ee43d6 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002633 Oct 27 13:16:58.098398 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 13/27] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:16:58 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:16:58.539350 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-94fef366-20a0-4812-a0c1-d8462852408a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:58.560613 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-94fef366-20a0-4812-a0c1-d8462852408a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.455914 Oct 27 13:16:58.561742 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 15/28] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:16:58 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:16:58.573928 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-f791ce04-a25c-41bf-9ea7-742b9c521d6a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:16:58.607178 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-f791ce04-a25c-41bf-9ea7-742b9c521d6a admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035699 Oct 27 13:16:58.607178 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 14/29] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Oct 27 13:16:58 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:17:01.194547 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-94fef366-20a0-4812-a0c1-d8462852408a admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:01.196514 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-94fef366-20a0-4812-a0c1-d8462852408a admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002260 Oct 27 13:17:01.197040 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 16/30] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:17:01 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:01.647837 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-53c20acc-2e71-42ff-b3a9-802a79eacf2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "disk": 80}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:01.653543 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:01.669750 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-53c20acc-2e71-42ff-b3a9-802a79eacf2f admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466064 Oct 27 13:17:01.670305 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 15/31] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:17:01 2022] POST /compute/v2.1/flavors => generated 405 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:17:01.682828 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-97872319-467f-4995-aaa1-a0309f5dd833 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:01.709485 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-97872319-467f-4995-aaa1-a0309f5dd833 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030236 Oct 27 13:17:01.710571 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 17/32] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Oct 27 13:17:01 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:17:04.318591 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-53c20acc-2e71-42ff-b3a9-802a79eacf2f admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:04.319612 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-53c20acc-2e71-42ff-b3a9-802a79eacf2f admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 27 13:17:04.320006 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 16/33] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:17:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:04.755963 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5"}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:04.765042 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:04.778030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.451945 Oct 27 13:17:04.778823 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 18/34] 10.222.0.48 () {64 vars in 1283 bytes} [Thu Oct 27 13:17:04 2022] POST /compute/v2.1/flavors => generated 408 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:17:04.791169 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-29ec8b08-9f61-4e17-acd2-c15c91baee23 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:04.816792 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-29ec8b08-9f61-4e17-acd2-c15c91baee23 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029209 Oct 27 13:17:04.817744 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 17/35] 10.222.0.48 () {64 vars in 1333 bytes} [Thu Oct 27 13:17:04 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:17:22.166202 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:22.167148 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Oct 27 13:17:22.167553 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 19/36] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:17:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:22.178456 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:17:22.552182 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-053c79d7-0269-44c7-bc7c-14a425a5fa08 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:22.569889 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-053c79d7-0269-44c7-bc7c-14a425a5fa08 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395899 Oct 27 13:17:22.570420 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 18/37] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Oct 27 13:17:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:17:23.850182 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:23.851182 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-7053fb6b-2d2d-4854-a3a0-8437a78a4690 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Oct 27 13:17:23.851596 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 20/38] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:24.375968 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-17e2b58e-0229-4f31-b5dc-c7247337fb37 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:24.381543 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-17e2b58e-0229-4f31-b5dc-c7247337fb37 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-17e2b58e-0229-4f31-b5dc-c7247337fb37 admin admin] Request method failure captured: Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept: application/json Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Connection: keep-alive Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Content-Length: 0 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Host: 10.222.0.48 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABjWoTjQgFeoI8DluVUz9NrbdZ3UCH233hO-JTSy821EBlwZ3Qw_ap_LxFW3EF5ZvKUz0kJp8tX8sRUE1WmzsCT-kAHhbHrKRlxggwiZ2N67J4FDtao1iCC7db04Uu6WEGUa6MKpONt5M_KtuEDg8ZCcPokFv2sNhfOrAdEZU-EUHj65J4 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Role: admin,reader,member Oct 27 13:17:24.384785 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Roles: admin,reader,member Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant: admin Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User: admin Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Name: admin Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: method: > Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: exception: Flavor 42 could not be found. Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: action_args: {'id': '42'} Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:24.386412 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:24.387414 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.388766 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-17e2b58e-0229-4f31-b5dc-c7247337fb37 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:24.390093 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-17e2b58e-0229-4f31-b5dc-c7247337fb37 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.385393 Oct 27 13:17:24.390093 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 19/39] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Oct 27 13:17:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:24.395648 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-64cb9d9b-4461-413e-a813-67dbe5b917c2 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:24.419296 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-64cb9d9b-4461-413e-a813-67dbe5b917c2 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027170 Oct 27 13:17:24.419831 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 21/40] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:17:24.430856 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-a96ce77c-bfa5-47d2-9c02-6371d07eb75d admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:24.452086 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-a96ce77c-bfa5-47d2-9c02-6371d07eb75d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025697 Oct 27 13:17:24.452631 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 20/41] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:17:24.461704 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-973b4478-e2fc-4b9b-b62d-6df911604d99 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:24.466799 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-973b4478-e2fc-4b9b-b62d-6df911604d99 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-973b4478-e2fc-4b9b-b62d-6df911604d99 admin admin] Request method failure captured: Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept: application/json Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Connection: keep-alive Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Content-Length: 0 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Host: 10.222.0.48 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABjWoTjQgFeoI8DluVUz9NrbdZ3UCH233hO-JTSy821EBlwZ3Qw_ap_LxFW3EF5ZvKUz0kJp8tX8sRUE1WmzsCT-kAHhbHrKRlxggwiZ2N67J4FDtao1iCC7db04Uu6WEGUa6MKpONt5M_KtuEDg8ZCcPokFv2sNhfOrAdEZU-EUHj65J4 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Role: admin,reader,member Oct 27 13:17:24.470583 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Roles: admin,reader,member Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant: admin Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User: admin Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Name: admin Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: method: > Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: exception: Flavor 42 could not be found. Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: action_args: {'id': '42'} Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:24.472073 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:24.473022 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:24.474030 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-973b4478-e2fc-4b9b-b62d-6df911604d99 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:24.475102 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-973b4478-e2fc-4b9b-b62d-6df911604d99 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013924 Oct 27 13:17:24.475102 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 22/42] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Oct 27 13:17:24 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:25.664096 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-a96ce77c-bfa5-47d2-9c02-6371d07eb75d admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:25.665158 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-a96ce77c-bfa5-47d2-9c02-6371d07eb75d admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Oct 27 13:17:25.665554 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 21/43] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:17:26.177478 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b7a50b3b-236c-400f-b0b9-32124f3c0693 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:26.182443 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-b7a50b3b-236c-400f-b0b9-32124f3c0693 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b7a50b3b-236c-400f-b0b9-32124f3c0693 admin admin] Request method failure captured: Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept: application/json Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Connection: keep-alive Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Content-Length: 0 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Host: 10.222.0.48 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABjWoTlNh15V3AZGLKTgXHNh1Vq4VCMb5WxE6rieSoUwSDnpgTI3EeuNB-MkIDVLAUWpAXeWKCKtC9OGQD09jQVocTN_s_GPfwt-XMogDe_ymE789QSA8V5d1OxvmvDk3WjGnxO4YpKKadJ4Zuh4siN3wtD08fMEORl_NCnmTDhOOpEMFQ Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Role: admin,reader,member Oct 27 13:17:26.183943 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Roles: admin,reader,member Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant: admin Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User: admin Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Name: admin Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: method: > Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: exception: Flavor 84 could not be found. Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: action_args: {'id': '84'} Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:26.185579 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:26.186520 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.187703 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b7a50b3b-236c-400f-b0b9-32124f3c0693 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:26.188722 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-b7a50b3b-236c-400f-b0b9-32124f3c0693 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.383910 Oct 27 13:17:26.188722 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 23/44] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Oct 27 13:17:25 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:26.194902 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9a824c6d-75bd-4c64-9599-47fd171e8511 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:26.210113 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-9a824c6d-75bd-4c64-9599-47fd171e8511 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018734 Oct 27 13:17:26.210686 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 22/45] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:17:26.220411 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e0a2e551-cc6d-409f-9ef9-0caaf5723460 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:26.236320 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e0a2e551-cc6d-409f-9ef9-0caaf5723460 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019861 Oct 27 13:17:26.236854 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 24/46] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:17:26.245982 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-2f414b23-10f9-4d92-9eca-0eebb972e735 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:26.250990 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-2f414b23-10f9-4d92-9eca-0eebb972e735 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-2f414b23-10f9-4d92-9eca-0eebb972e735 admin admin] Request method failure captured: Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept: application/json Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Connection: keep-alive Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Content-Length: 0 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Host: 10.222.0.48 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABjWoTlNh15V3AZGLKTgXHNh1Vq4VCMb5WxE6rieSoUwSDnpgTI3EeuNB-MkIDVLAUWpAXeWKCKtC9OGQD09jQVocTN_s_GPfwt-XMogDe_ymE789QSA8V5d1OxvmvDk3WjGnxO4YpKKadJ4Zuh4siN3wtD08fMEORl_NCnmTDhOOpEMFQ Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Role: admin,reader,member Oct 27 13:17:26.252508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Roles: admin,reader,member Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant: admin Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User: admin Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Name: admin Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: method: > Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: exception: Flavor 84 could not be found. Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: action_args: {'id': '84'} Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:26.254268 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:26.255242 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:26.256508 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-2f414b23-10f9-4d92-9eca-0eebb972e735 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:26.257744 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-2f414b23-10f9-4d92-9eca-0eebb972e735 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011377 Oct 27 13:17:26.257744 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 23/47] 10.222.0.48 () {60 vars in 1190 bytes} [Thu Oct 27 13:17:26 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 27 13:17:27.448624 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-e0a2e551-cc6d-409f-9ef9-0caaf5723460 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:27.449634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-e0a2e551-cc6d-409f-9ef9-0caaf5723460 admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Oct 27 13:17:27.450031 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 25/48] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:27.966851 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9713ce73-3266-4e42-957c-df21155ad09d admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:27.973316 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.wsgi [None req-9713ce73-3266-4e42-957c-df21155ad09d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9713ce73-3266-4e42-957c-df21155ad09d admin admin] Request method failure captured: Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept: application/json Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Accept-Encoding: gzip, deflate Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Connection: keep-alive Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Content-Length: 0 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Host: 10.222.0.48 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Openstack-System-Scope: None Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: User-Agent: python-novaclient Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Auth-Token: gAAAAABjWoTnXq9Uju736d6FxG6aD4kOkEM0yTkni3gTDiJfmVSoy8d3a_u7tyLzDsHmzE4YMa2jV23lojqol3aJFsn6_B3VNiHn3PDb1a9XbTs7SkuuIlFpzgFPKVTTj-0tqosJmK4_iIyVqwchJ9lcGj5uX4WGTk6-VcNy-7Hys9oL1n50pW4 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Id: None Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Domain-Name: None Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Identity-Status: Confirmed Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Is-Admin-Project: True Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Id: default Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Domain-Name: Default Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Project-Name: admin Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Role: admin,reader,member Oct 27 13:17:27.974815 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Roles: admin,reader,member Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant: admin Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-Tenant-Name: admin Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User: admin Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Id: default Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Domain-Name: Default Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: X-User-Name: admin Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: method: > Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: exception: Flavor 451 could not be found. Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: action_args: {'id': '451'} Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:27.976340 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:27.977217 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: ERROR nova.api.openstack.wsgi Oct 27 13:17:27.978367 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-9713ce73-3266-4e42-957c-df21155ad09d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103716) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:27.979556 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-9713ce73-3266-4e42-957c-df21155ad09d admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.389846 Oct 27 13:17:27.979556 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 24/49] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:17:27 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:27.985865 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-66fb68b7-3e81-4f10-a71c-5a0849f6bb54 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:28.000456 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-66fb68b7-3e81-4f10-a71c-5a0849f6bb54 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018268 Oct 27 13:17:28.001007 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 26/50] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:17:28.010351 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:28.025499 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018611 Oct 27 13:17:28.026077 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 25/51] 10.222.0.48 () {60 vars in 1210 bytes} [Thu Oct 27 13:17:28 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:17:28.035456 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-874a255a-583a-4669-b1ff-8d111c75cea9 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:28.040340 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.wsgi [None req-874a255a-583a-4669-b1ff-8d111c75cea9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-874a255a-583a-4669-b1ff-8d111c75cea9 admin admin] Request method failure captured: Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept: application/json Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Accept-Encoding: gzip, deflate Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Connection: keep-alive Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Content-Length: 0 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Host: 10.222.0.48 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-Api-Version: compute 2.92 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Openstack-System-Scope: None Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: User-Agent: python-novaclient Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Auth-Token: gAAAAABjWoTnXq9Uju736d6FxG6aD4kOkEM0yTkni3gTDiJfmVSoy8d3a_u7tyLzDsHmzE4YMa2jV23lojqol3aJFsn6_B3VNiHn3PDb1a9XbTs7SkuuIlFpzgFPKVTTj-0tqosJmK4_iIyVqwchJ9lcGj5uX4WGTk6-VcNy-7Hys9oL1n50pW4 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Id: None Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Domain-Name: None Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Identity-Status: Confirmed Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Is-Admin-Project: True Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Openstack-Nova-Api-Version: 2.92 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Id: default Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Domain-Name: Default Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Project-Name: admin Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Role: admin,reader,member Oct 27 13:17:28.041813 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Roles: admin,reader,member Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f354da2936f649f78cdcb89056983d15"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f354da2936f649f78cdcb89056983d15"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f354da2936f649f78cdcb89056983d15"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant: admin Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Id: f354da2936f649f78cdcb89056983d15 Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-Tenant-Name: admin Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User: admin Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Id: default Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Domain-Name: Default Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Id: 299712f6a5bb49b986da988b00e6dbe7 Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: X-User-Name: admin Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: method: > Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: exception: Flavor 451 could not be found. Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: action_args: {'id': '451'} Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:17:28.043374 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:28.044372 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: ERROR nova.api.openstack.wsgi Oct 27 13:17:28.045634 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-874a255a-583a-4669-b1ff-8d111c75cea9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103717) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:17:28.046858 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-874a255a-583a-4669-b1ff-8d111c75cea9 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011084 Oct 27 13:17:28.046858 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 27/52] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:17:28 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 27 13:17:29.227817 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:29.228873 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Oct 27 13:17:29.229264 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 26/53] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:29.751543 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-92ae2335-a7f7-4dcd-bdf5-581f58bbce5b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:29.771769 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-92ae2335-a7f7-4dcd-bdf5-581f58bbce5b admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.402688 Oct 27 13:17:29.772328 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 28/54] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Oct 27 13:17:29 2022] POST /compute/v2.1/flavors => generated 404 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:17:30.971755 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:30.972840 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Oct 27 13:17:30.973238 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 27/55] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:31.490472 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f34af888-3492-4f2d-9c93-118a16f22032 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:31.508685 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f34af888-3492-4f2d-9c93-118a16f22032 admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.393382 Oct 27 13:17:31.509228 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 29/56] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Oct 27 13:17:31 2022] POST /compute/v2.1/flavors => generated 405 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:17:32.716994 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:32.718876 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002281 Oct 27 13:17:32.719459 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 28/57] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:17:33.231234 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-493df680-b616-4a0f-9002-002ca67c14cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:33.250021 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-493df680-b616-4a0f-9002-002ca67c14cf admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.393923 Oct 27 13:17:33.250578 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 30/58] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Oct 27 13:17:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:17:34.442668 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:34.443686 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Oct 27 13:17:34.444074 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 29/59] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:34.955118 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-20173d6a-cd77-42a8-82db-b8d21286afef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:17:34.973173 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-20173d6a-cd77-42a8-82db-b8d21286afef admin admin] 10.222.0.48 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.392027 Oct 27 13:17:34.973818 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 31/60] 10.222.0.48 () {64 vars in 1235 bytes} [Thu Oct 27 13:17:34 2022] POST /compute/v2.1/flavors => generated 409 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:17:36.167919 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:36.168963 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 27 13:17:36.169357 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 30/61] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:17:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:17:36.683398 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-b8eb4be8-a83e-4fef-8747-917f7fb06f93 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:17:36.704566 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-b8eb4be8-a83e-4fef-8747-917f7fb06f93 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.398341 Oct 27 13:17:36.705106 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 32/62] 10.222.0.48 () {60 vars in 1202 bytes} [Thu Oct 27 13:17:36 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:18:32.816380 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:32.817334 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-6033263d-cb50-40d2-a74b-1d9cfedc811e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Oct 27 13:18:32.817733 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 31/63] 10.222.0.48 () {54 vars in 931 bytes} [Thu Oct 27 13:18:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:18:32.828825 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:33.202545 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-26714b6f-b507-41ad-8c0f-c18eeab1c0c8 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:33.222526 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-26714b6f-b507-41ad-8c0f-c18eeab1c0c8 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398825 Oct 27 13:18:33.223057 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 33/64] 10.222.0.48 () {60 vars in 1292 bytes} [Thu Oct 27 13:18:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:18:33.245816 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=14 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:18:33.250211 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-8e7d1160-6405-4bad-ac1c-dbcd03094f45 admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:33.257771 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-8e7d1160-6405-4bad-ac1c-dbcd03094f45 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013403 Oct 27 13:18:33.258306 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 32/65] 10.222.0.48 () {60 vars in 1283 bytes} [Thu Oct 27 13:18:33 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:18:33.269903 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-44c69950-a252-40b9-ae87-541f746762e6 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:33.277056 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-44c69950-a252-40b9-ae87-541f746762e6 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010732 Oct 27 13:18:33.277565 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 34/66] 10.222.0.48 () {60 vars in 1286 bytes} [Thu Oct 27 13:18:33 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:18:33.288560 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:33.296170 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011088 Oct 27 13:18:33.296739 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 33/67] 10.222.0.48 () {60 vars in 1286 bytes} [Thu Oct 27 13:18:33 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:18:33.307836 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-f3c19151-405a-4fd5-aede-0bf83a1287a4 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:18:33.315487 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-f3c19151-405a-4fd5-aede-0bf83a1287a4 admin admin] 10.222.0.48 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011151 Oct 27 13:18:33.315992 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 35/68] 10.222.0.48 () {60 vars in 1283 bytes} [Thu Oct 27 13:18:33 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:21:53.552536 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:21:53.553560 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Oct 27 13:21:53.553988 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 34/69] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:21:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:21:53.695540 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=6 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:21:53.851566 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:21:53.856319 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:21:53.856790 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:21:53.857211 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:21:53.858004 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:21:53.858448 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:21:53.858864 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:21:53.891317 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-d9f5bf48-525c-4102-b6e9-ca71b2ca7997 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197026 Oct 27 13:21:53.891807 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 36/70] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:21:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:21:54.963033 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:21:54.964039 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Oct 27 13:21:54.964467 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 35/71] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:21:55.158996 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:21:55.162405 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:21:55.162875 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:21:55.163294 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:21:55.164002 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:21:55.164481 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:21:55.164896 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:21:55.184375 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-199e89c1-a29d-4ed9-9e2e-7932b5075bc7 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.078551 Oct 27 13:21:55.184855 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 37/72] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:21:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:22:06.643952 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:22:06.644983 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Oct 27 13:22:06.645399 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 36/73] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:22:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:22:06.787018 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell0:SELECT=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:22:06.787731 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_cell1:SELECT=4 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:22:06.788380 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG dbcounter [-] [103717] Writing DB stats nova_api:SELECT=8 {{(pid=103717) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:22:06.841206 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:22:06.845769 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:22:06.846235 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:22:06.846652 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:22:06.847356 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:22:06.847794 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:22:06.848198 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:22:06.875633 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-91cb1b5c-e3db-442f-9cae-717af2d8fe46 admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.093008 Oct 27 13:22:06.876462 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 38/74] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:22:06 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:22:07.930736 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG nova.api.openstack.wsgi [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] Calling method '>' {{(pid=103716) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:22:07.931752 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: INFO nova.api.openstack.requestlog [None req-48b5fc35-cbb1-4159-a336-5a6acea6204e admin admin] 10.222.0.48 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Oct 27 13:22:07.932153 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: [pid: 103716|app: 0|req: 37/75] 10.222.0.48 () {56 vars in 1074 bytes} [Thu Oct 27 13:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:22:08.126375 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG nova.api.openstack.wsgi [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Calling method '>' {{(pid=103717) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:22:08.129851 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:22:08.130315 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:22:08.130732 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:22:08.131428 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:22:08.131863 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:22:08.132286 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: DEBUG oslo_concurrency.lockutils [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103717) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:22:08.154474 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: INFO nova.api.openstack.requestlog [None req-a38186f8-3d6e-4c9d-a828-7a20db31d7dd admin admin] 10.222.0.48 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078766 Oct 27 13:22:08.154947 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: [pid: 103717|app: 0|req: 39/76] 10.222.0.48 () {60 vars in 1193 bytes} [Thu Oct 27 13:22:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:23:05.467233 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: Thu Oct 27 13:23:05 2022 - graceful shutdown triggered... Oct 27 13:23:05.467747 dv-cinder-862432-3-iscsi devstack@n-api.service[103717]: Gracefully killing worker 2 (pid: 103717)... Oct 27 13:23:05.467360 dv-cinder-862432-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 27 13:23:05.468618 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: Gracefully killing worker 1 (pid: 103716)... Oct 27 13:23:05.594335 dv-cinder-862432-3-iscsi devstack@n-api.service[103716]: DEBUG dbcounter [-] [103716] Writing DB stats nova_api:SELECT=4 {{(pid=103716) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:06.468353 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: worker 1 buried after 1 seconds Oct 27 13:23:06.468754 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: worker 2 buried after 1 seconds Oct 27 13:23:06.468754 dv-cinder-862432-3-iscsi devstack@n-api.service[103715]: goodbye to uWSGI. Oct 27 13:23:06.469950 dv-cinder-862432-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 27 13:23:06.470512 dv-cinder-862432-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 27 13:23:06.473232 dv-cinder-862432-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 27 13:23:06.487213 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 27 13:23:06 2022] *** Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: nodename: dv-cinder-862432-3-iscsi Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: machine: x86_64 Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: clock source: unix Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: pcre jit disabled Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: detected number of CPU cores: 4 Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: current working directory: / Oct 27 13:23:06.489842 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: detected binary path: /usr/bin/uwsgi-core Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: your processes number limit is 47680 Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: your memory page size is 4096 bytes Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: detected max file descriptor number: 2048 Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: lock engine: pthread robust mutexes Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: thunder lock: enabled Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 27 13:23:06.490641 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 27 13:23:06.529516 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: Python main interpreter initialized at 0x55d7a9be59c0 Oct 27 13:23:06.529516 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: python threads support enabled Oct 27 13:23:06.529516 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: your server socket listen backlog is limited to 100 connections Oct 27 13:23:06.529516 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: your mercy for graceful operations on workers is 90 seconds Oct 27 13:23:06.529956 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: mapped 403077 bytes (393 KB) for 2 cores Oct 27 13:23:06.530033 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: *** Operational MODE: preforking *** Oct 27 13:23:06.530791 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: *** uWSGI is running in multiple interpreter mode *** Oct 27 13:23:06.530791 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: spawned uWSGI master process (pid: 118751) Oct 27 13:23:06.533888 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: spawned uWSGI worker 1 (pid: 118773, cores: 1) Oct 27 13:23:06.533888 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: spawned uWSGI worker 2 (pid: 118774, cores: 1) Oct 27 13:23:06.533888 dv-cinder-862432-3-iscsi devstack@n-api.service[118751]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 27 13:23:06.530991 dv-cinder-862432-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 27 13:23:07.194295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 13:23:07.203795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 27 13:23:08.442147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:23:08.442147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: from cryptography.utils import int_from_bytes Oct 27 13:23:08.442721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:23:08.442721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: from cryptography.utils import int_from_bytes Oct 27 13:23:08.455969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:23:08.455969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: from cryptography.utils import int_from_bytes Oct 27 13:23:08.456591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 27 13:23:08.456591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: from cryptography.utils import int_from_bytes Oct 27 13:23:10.879248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:23:10.879812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:23:10.880123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:23:10.880455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:23:10.880718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:23:10.881096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.881423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.881745 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.882065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.882397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.882710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.883038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.883360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.883690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.883954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.884291 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.884620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-3-iscsi {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.884946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.885252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.890372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.890372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.890579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 27 13:23:10.890964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 27 13:23:10.891133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 27 13:23:10.891272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 27 13:23:10.891414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 27 13:23:10.891596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.891988 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.892066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.892146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.895801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.896877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897505 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-3-iscsi {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.897986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-862432-3-iscsi {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.898944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.899228 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.899382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.900868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.901022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.901204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.901352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.901509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.901666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.902573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.902573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.902891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903702 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.903867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.904515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.904667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.904822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.904983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.905996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.906918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-862432-3-iscsi {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907359 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907661 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.907965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.908961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.909961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910120 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.910873 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911460 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.911904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912076 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.912902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913231 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913684 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.913835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.914765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915062 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.915982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.916974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917118 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917405 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.917867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918162 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.918961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919112 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.919769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.920051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.48 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.920389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.920558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.48 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.920714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.920865 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.921016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.921159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.921314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.921465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.924348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.924522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.924682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.924837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.924990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.925880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926639 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.926935 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927229 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927529 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927684 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.927989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928819 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.928972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.929866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930616 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.930918 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.931978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.932975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933577 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.933891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.934960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935392 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935700 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.935987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.936648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.936814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.936978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.937125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.937268 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.937413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.937564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.937714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.937872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.938017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.938169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.938324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.938475 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.938682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.938827 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.938983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.939135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.939288 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.939431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.939584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.939728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.939871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.940028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.940174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.940366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.940523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.940676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.940831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.940975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.941127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.941272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.941426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.941578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.941729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.941873 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.942023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.942023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.942310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.942453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.942597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.942750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.942894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 27 13:23:10.943198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.943920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.944879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.945983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946136 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.946886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.947932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948619 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.948922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.949895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.950929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.951082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.951234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.951378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.951522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.951666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.952588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.952761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.952921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953688 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.953986 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.954875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.955936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.956080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.956326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.957985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958331 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958477 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.958969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959277 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.959871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960661 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.960971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961567 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.961868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962470 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962783 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.962935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.963866 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.964908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.965930 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966241 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966241 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.966964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967270 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.967900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968381 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968562 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.968925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969081 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969224 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.969817 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.970927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971235 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.971990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972467 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972633 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.972926 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973806 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.973951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.974901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.975952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.976939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977836 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.977994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.978921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979076 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979229 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.979975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980290 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980750 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.980902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981660 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.981956 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.982968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983450 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.983890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.984874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985210 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985370 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985521 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.985978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.986899 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987381 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.987857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.988986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989143 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.989942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.990862 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.991955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992470 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.992932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993082 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993732 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.994961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995446 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.995913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.996951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997263 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.997909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.998062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.998219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.998370 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.998535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999382 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:10.999987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.000999 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.001927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002404 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.002874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.003987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.004959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.005274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.005427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.005578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.005729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.005888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.006919 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007695 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.007847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.008998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.009148 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.009307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.009479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.009696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.009852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.010949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.011354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.011557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.011723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.011882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012042 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.012973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013293 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013613 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.013934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.014087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.014312 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.014957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015282 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015586 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.015900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.016945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017112 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017286 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017741 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.017900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.018989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019629 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.019946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.020097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.020285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.020495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.020679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.020846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021319 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.021969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.022934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.023878 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024703 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.024854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.025963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026585 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.026887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.027840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028797 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.028951 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.029112 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.029265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.029416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.029574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.029748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.030433 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.030622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.030776 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.030928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031405 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.031875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032734 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.032887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.033981 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034489 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.034920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035692 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035776 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.035940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036649 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.036919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037182 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.037947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038819 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.038992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.039935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040635 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.040998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041361 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041444 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.041916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042545 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042772 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.042990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043533 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043629 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.043945 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044130 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.044966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045047 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.045490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046229 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046772 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.046863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047455 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047543 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.047982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048145 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.048985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049242 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.049923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050101 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.050942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051529 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.051964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.052047 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.052136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.052709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.052818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.052915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053570 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053661 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053852 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.053957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054635 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.054948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.055871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.056830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.057969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058072 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058313 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058419 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.058946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059248 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059898 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.059988 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060643 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.060975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.061242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.061555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.061893 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062228 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.062878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063190 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.063841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.064799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.065927 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.066964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.067893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068434 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.068852 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.069828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070036 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.070993 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.071091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.071309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.071407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.071627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.071726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.072982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.073864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.074083 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.074384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.074486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.074705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.074797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075024 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.075973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.076976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077075 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077392 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.077938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.078911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079543 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.079950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.080968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081576 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.081902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082430 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.082862 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083688 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.083809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.084979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.085928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.086025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.086244 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.086459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.086553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.086781 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087496 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.087826 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.088814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089351 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.089964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.090976 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.091921 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.092132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.092933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.093974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094185 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.094926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095141 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095238 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.095856 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.096064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.096178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.096416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.096705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.096807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097013 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097740 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.097947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.098962 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.099892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100751 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.100852 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101455 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.101972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102063 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102679 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.102992 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.103919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104153 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.104880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.105809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.106981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.107948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.108771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109531 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.109833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110351 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110442 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.110987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.111922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.112968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113531 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113634 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.113901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.114819 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115443 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.115968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116305 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.116954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.117994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118296 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118606 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.118919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.119859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120073 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120797 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.120914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.121861 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122069 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.122797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.123808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.124963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125275 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125688 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.125992 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.126921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127134 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127539 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.127832 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.128986 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129330 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.129984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.130897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131190 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.131809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.132955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133358 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.133920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134330 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.134864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135281 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135484 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135575 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.135906 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.136406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.136515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.136723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.136813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.137968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138069 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.138993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.139999 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140626 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140860 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.140968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141788 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.141892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.142801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.143736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.144910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145644 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.145969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146609 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.146932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147475 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147567 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147786 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.147886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.148033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118774) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:23:11.148138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.148466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.148780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.149090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 27 13:23:11.149334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118773) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 27 13:23:11.210800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO dbcounter [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Registered counter for database nova_api Oct 27 13:23:11.211876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO dbcounter [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Registered counter for database nova_api Oct 27 13:23:11.231409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_db.sqlalchemy.engines [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.233009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_db.sqlalchemy.engines [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.238161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writer thread running {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.239590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writer thread running {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.295997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.context [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce8722d1-aebc-456c-be32-911a0277d16a(cell1) {{(pid=118774) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:23:11.296535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.context [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ce8722d1-aebc-456c-be32-911a0277d16a(cell1) {{(pid=118773) load_cells /opt/stack/nova/nova/context.py:464}} Oct 27 13:23:11.300056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:23:11.300532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:23:11.300639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:23:11.301013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:23:11.302132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:23:11.302598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:23:11.302860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:23:11.303308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:23:11.303418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:23:11.303763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:23:11.305383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:23:11.305867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:23:11.307363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO dbcounter [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Registered counter for database nova_cell0 Oct 27 13:23:11.308321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO dbcounter [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Registered counter for database nova_cell0 Oct 27 13:23:11.312306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO dbcounter [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Registered counter for database nova_cell1 Oct 27 13:23:11.312830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO dbcounter [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Registered counter for database nova_cell1 Oct 27 13:23:11.319955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_db.sqlalchemy.engines [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.322307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_db.sqlalchemy.engines [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.323979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_db.sqlalchemy.engines [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.325581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writer thread running {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.327519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writer thread running {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.328160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_db.sqlalchemy.engines [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.466877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writer thread running {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.469128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writer thread running {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.475995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO dbcounter [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Registered counter for database nova_cell0 Oct 27 13:23:11.477803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO dbcounter [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Registered counter for database nova_cell0 Oct 27 13:23:11.483736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_db.sqlalchemy.engines [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118774) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.484609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_db.sqlalchemy.engines [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118773) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 27 13:23:11.487513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writer thread running {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.489034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writer thread running {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 27 13:23:11.806891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: WARNING keystonemiddleware.auth_token [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:23:11.809297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: WARNING keystonemiddleware.auth_token [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:23:11.814678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: WARNING keystonemiddleware.auth_token [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:23:11.817127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: WARNING keystonemiddleware.auth_token [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:23:12.159426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: WARNING keystonemiddleware.auth_token [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:23:12.162216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: WARNING keystonemiddleware.auth_token [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 27 13:23:12.165463 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: WARNING keystonemiddleware.auth_token [None req-8e302970-2fa8-4f37-95ba-0751978f2eb6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:23:12.168376 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: WARNING keystonemiddleware.auth_token [None req-36c2d2bd-a19a-43cc-bc54-9ab85a367055 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 27 13:23:12.171311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d7a9be59c0 pid: 118774 (default app) Oct 27 13:23:12.174266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d7a9be59c0 pid: 118773 (default app) Oct 27 13:23:48.170305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:48.171410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:48.173000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:48.175045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:49.356959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-04367339-f61b-4202-9dcf-1fee6a55d111 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Action: 'create', calling method: .version_select at 0x7fb374512ee0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2072377196", "metadata": {"Type": "work"}}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-04367339-f61b-4202-9dcf-1fee6a55d111 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 122 Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:23:49.370107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2072377196", "metadata": {"Type": "work"}}} Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: Oct 27 13:23:49.371554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2072377196', 'metadata': {'Type': 'work'}}}} Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise error Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi '#$%' Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:49.372969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 13:23:49.374299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 13:23:49.375432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 27 13:23:49.375432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.377309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-04367339-f61b-4202-9dcf-1fee6a55d111 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:49.378704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-04367339-f61b-4202-9dcf-1fee6a55d111 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.214664 Oct 27 13:23:49.379841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 1/1] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Oct 27 13:23:48 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1217 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:23:49.394654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:49.396406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:49.399374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:49.402391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:23:49.921725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a7697723-cca7-40d0-b691-6782d73a8062 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Action: 'create', calling method: .version_select at 0x7fb374507af0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1425901633", "metadata": {"Type": "work"}}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a7697723-cca7-40d0-b691-6782d73a8062 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 120 Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:23:49.932793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1425901633", "metadata": {"Type": "work"}}} Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:23:49.934469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1425901633', 'metadata': {'Type': 'work'}}}} Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise error Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi '0' Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:49.935397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 13:23:49.936979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 13:23:49.938266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 27 13:23:49.938266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.950958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a7697723-cca7-40d0-b691-6782d73a8062 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:49.952502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a7697723-cca7-40d0-b691-6782d73a8062 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.565022 Oct 27 13:23:49.953556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 1/2] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Oct 27 13:23:49 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 568 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:23:49.964695 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-53badc8a-6ab5-4fca-86aa-ef5971368286 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Action: 'create', calling method: .version_select at 0x7fb3744d7790>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574133892", "metadata": {"Type": "work"}}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-53badc8a-6ab5-4fca-86aa-ef5971368286 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 118 Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:23:49.969193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-574133892", "metadata": {"Type": "work"}}} Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: Oct 27 13:23:49.970482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-574133892', 'metadata': {'Type': 'work'}}}} Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise error Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi '' Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:49.971233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 27 13:23:49.973337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 27 13:23:49.974665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 27 13:23:49.974665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:49.977193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-53badc8a-6ab5-4fca-86aa-ef5971368286 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:49.978128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-53badc8a-6ab5-4fca-86aa-ef5971368286 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.017798 Oct 27 13:23:49.985066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 2/3] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Oct 27 13:23:49 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:23:49.989971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ec321d0-8d83-465f-a715-8dc419031551 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Calling method '.version_select at 0x7fb3743e23a0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:23:51.174170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-7ec321d0-8d83-465f-a715-8dc419031551 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] HTTP exception thrown: Volume tempest-invalid-1854451156 could not be found. Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ec321d0-8d83-465f-a715-8dc419031551 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1854451156 HTTP/1.1 Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:23:51.178514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Volume tempest-invalid-1854451156 could not be found. Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'tempest-invalid-1854451156'} Oct 27 13:23:51.180046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1854451156 could not be found. (HTTP 404) (Request-ID: req-4bcd7183-e037-4a4e-b33c-3a03023c868a) Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.180841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:23:51.182026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1854451156 could not be found. Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:23:51.185897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1854451156 could not be found. Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1854451156 could not be found. Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ec321d0-8d83-465f-a715-8dc419031551 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 404 to user: Volume tempest-invalid-1854451156 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:51.187071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7ec321d0-8d83-465f-a715-8dc419031551 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1854451156" status: 404 len: 99 microversion: 2.1 time: 1.194314 Oct 27 13:23:51.190715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-580d3895-d28c-4693-b9a4-5f328101539f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003650 Oct 27 13:23:51.195652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 3/4] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Oct 27 13:23:51 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 13:23:51.200172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2bee1031-4574-49d7-a92e-621b85b956b5 tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003467 Oct 27 13:23:51.204590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 2/5] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Oct 27 13:23:49 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1854451156 => generated 99 bytes in 1220 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 27 13:23:51.214530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d663f64-4f58-46f9-baf6-57c90b1dc25f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Calling method '.version_select at 0x7fb374d1a280>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:23:51.216000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 4/6] 10.222.0.48 () {58 vars in 1137 bytes} [Thu Oct 27 13:23:51 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 20 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 27 13:23:51.359986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-3d663f64-4f58-46f9-baf6-57c90b1dc25f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] HTTP exception thrown: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d663f64-4f58-46f9-baf6-57c90b1dc25f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/os-volumes/d8504ae2-f79a-4bd0-8b8e-f76574e69290 HTTP/1.1 Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:23:51.362519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'd8504ae2-f79a-4bd0-8b8e-f76574e69290'} Oct 27 13:23:51.364043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. (HTTP 404) (Request-ID: req-5c28c382-c9a0-4dff-806b-63ce9162206f) Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.364980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:23:51.366255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 13:23:51.368107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. Oct 27 13:23:51.369372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.371251 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d663f64-4f58-46f9-baf6-57c90b1dc25f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 404 to user: Volume d8504ae2-f79a-4bd0-8b8e-f76574e69290 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:51.372385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3d663f64-4f58-46f9-baf6-57c90b1dc25f tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/d8504ae2-f79a-4bd0-8b8e-f76574e69290" status: 404 len: 109 microversion: 2.1 time: 0.166595 Oct 27 13:23:51.373083 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 3/7] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:23:51 2022] DELETE /compute/v2.1/os-volumes/d8504ae2-f79a-4bd0-8b8e-f76574e69290 => generated 109 bytes in 168 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:23:51.382663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c192c4de-d342-4da9-b577-c85aae68615b tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Calling method '.version_select at 0x7fb374384040>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:23:51.617861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-c192c4de-d342-4da9-b577-c85aae68615b tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] HTTP exception thrown: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c192c4de-d342-4da9-b577-c85aae68615b tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Request method failure captured: Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/os-volumes/a073ea73-d5ff-4c02-a323-2dd6e7dc3471 HTTP/1.1 Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZk72SRHXkh9JUknCCgv0usJGfH7VXmNxRw45Z4oYK938C9Z5RQuZ73edb9Rf52o9HF8o9k8H5wyb3FI9gobFvE8EhqR8A5p6lVT94voMYTcC1Rh6Bmb3hTdAVTNQ6n4QsCsWEEq_PZzK3oEaMDLn6Cos8BfC0Z9LwvY_5ZR9mTiRI Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:23:51.623218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f6200925c5054329a030ccb01d03fd6c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: f6200925c5054329a030ccb01d03fd6c Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-VolumesNegativeTest-2073223562 Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 054ae31acea4491fa25e7b6620b22bad Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-VolumesNegativeTest-2073223562-project Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'a073ea73-d5ff-4c02-a323-2dd6e7dc3471'} Oct 27 13:23:51.625049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. (HTTP 404) (Request-ID: req-1ad37fe7-9aa2-46a5-9321-71b1f0075504) Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.626205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:23:51.627333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 13:23:51.628461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c192c4de-d342-4da9-b577-c85aae68615b tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] Returning 404 to user: Volume a073ea73-d5ff-4c02-a323-2dd6e7dc3471 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:23:51.632591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c192c4de-d342-4da9-b577-c85aae68615b tempest-VolumesNegativeTest-2073223562 tempest-VolumesNegativeTest-2073223562-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/a073ea73-d5ff-4c02-a323-2dd6e7dc3471" status: 404 len: 109 microversion: 2.1 time: 0.250275 Oct 27 13:23:51.646111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 5/8] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:23:51 2022] GET /compute/v2.1/os-volumes/a073ea73-d5ff-4c02-a323-2dd6e7dc3471 => generated 109 bytes in 268 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:23:57.355928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1876177628", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "networks": [{"uuid": "cd96fa99-4c66-43df-b333-f0dba8530cad"}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:23:57.530715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] validate_networks() for [('cd96fa99-4c66-43df-b333-f0dba8530cad', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:24:00.762246 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:24:00.763715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:24:00.764620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:24:00.765418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:24:00.766251 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:24:00.812416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:00.813190 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:00.813834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:00.814774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:00.815729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:00.816461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:00.887980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Getting quotas for project cecd3a5ba83e47119462cb9166e9a80a. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:00.902383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Getting quotas for user 24289ae31c444a03b59ca5322f5abff2 and project cecd3a5ba83e47119462cb9166e9a80a. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:00.928942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:24:00.932670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:24:01.204913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0c92751c-ae96-45ac-b228-d9a9ed4bf8ff tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.463645 Oct 27 13:24:01.217719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 4/9] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 4480 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:24:01.221077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b390b728-6c74-415f-aee4-1d4e7f30a088 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:01.222520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b390b728-6c74-415f-aee4-1d4e7f30a088 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:01.505625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b390b728-6c74-415f-aee4-1d4e7f30a088 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:01.532948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b390b728-6c74-415f-aee4-1d4e7f30a088 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1215 microversion: 2.1 time: 0.317627 Oct 27 13:24:01.540512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 6/10] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:01 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1215 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:02.556307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a1f1e43e-0ce4-4ea2-b730-ceecea3c1fc9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:02.556946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a1f1e43e-0ce4-4ea2-b730-ceecea3c1fc9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:02.771920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a1f1e43e-0ce4-4ea2-b730-ceecea3c1fc9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:02.837950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a1f1e43e-0ce4-4ea2-b730-ceecea3c1fc9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1215 microversion: 2.1 time: 0.286199 Oct 27 13:24:02.861315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 5/11] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:02 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1215 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:03.874804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:03.875436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:03.891172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:03.893354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:03.895283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:03.901308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:03.906870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:03.908739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:04.144395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9d096cbe-0339-4912-adc1-962769486988 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: .version_select at 0x7fb3742b8700>, body: {"keypair": {"name": "tempest-keypair-768766039", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM/Qi4RhK3JUFa7TsNOjO6Jz32qfXZZcDZmNVSeOvu66q1Av6B48Z6rWz8gVQZRYtcpsu6hC0V+pcCEBY9/oGkJvOlNmCYSQjEMK8rbEDBrrp/e71NIl3ofLvleu/Foalg=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:04.289662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9d096cbe-0339-4912-adc1-962769486988 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:04.311042 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9d096cbe-0339-4912-adc1-962769486988 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for user 8f0bb483c548429295c02558520c6898 and project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:04.400507 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9d096cbe-0339-4912-adc1-962769486988 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.092629 Oct 27 13:24:04.401528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 7/12] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:24:03 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:04.427014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:04.450083 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-42ee7d91-6f0c-49fc-b0ea-5401c8e5809e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1267 microversion: 2.1 time: 0.578181 Oct 27 13:24:04.453243 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 6/13] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:03 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1267 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:05.479254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:05.481792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:05.517264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:05.517760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:05.530841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:05.533249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:05.534273 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:05.546233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:05.827193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1264704749", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:05.906394 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:05.918796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] validate_networks() for [('d7787e3c-cdc7-4d31-9969-b3505bdbc01b', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:24:05.928140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-95b81d76-c89e-4625-8ed7-e92b2b2f4e3a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1267 microversion: 2.1 time: 0.453972 Oct 27 13:24:05.933301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 8/14] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:05 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1267 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:06.363959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4fbb4585-f97c-4971-9380-e9998c1a886a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: .version_select at 0x7fb3742055e0>, body: {"keypair": {"name": "tempest-keypair-1285257590", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAmdRSJIY77opej3gVKRC7FklsiD8tfEDv9XREOS2d9RL0OVM/g46Kiz8Mxi1ohQVlMPDfVLeASZuFR/kgk2TqLO4wdM3QvwmZhn/BhyALpdgURJdFnWxF+RVMI71KBLNg=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:06.392670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-4fbb4585-f97c-4971-9380-e9998c1a886a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:06.399825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-4fbb4585-f97c-4971-9380-e9998c1a886a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for user e77228bb97fd40dfa311088f28864637 and project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:06.484396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4fbb4585-f97c-4971-9380-e9998c1a886a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.547949 Oct 27 13:24:06.485319 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 9/15] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Oct 27 13:24:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 551 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 13:24:06.846042 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:24:06.846785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:24:06.847360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:24:06.847781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:24:06.848201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:24:06.873192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:06.873887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:06.874583 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:06.875506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:06.876140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:06.876977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:06.900660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:06.906396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for user 97d696ea0031417d8a1a0b8471c26579 and project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:06.922162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:24:06.926896 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:24:06.958829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:06.959506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:06.988285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:06.990756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:06.991342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:06.994886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:06.995562 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:07.001200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:07.005277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3a16d1cd-fa86-40a5-8e07-88398484b2b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.465436 Oct 27 13:24:07.009687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 7/16] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:24:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 1471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:24:07.024478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b6815f6b-7159-48f2-a271-9605c8444a91 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:07.026511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b6815f6b-7159-48f2-a271-9605c8444a91 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:07.190711 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b6815f6b-7159-48f2-a271-9605c8444a91 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:07.219324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b6815f6b-7159-48f2-a271-9605c8444a91 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1222 microversion: 2.1 time: 0.201047 Oct 27 13:24:07.227390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 8/17] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:07 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1222 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:07.349177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:07.373791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6ed7c7ac-a1d2-4265-b179-9b8f6dcbbf4a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1267 microversion: 2.1 time: 0.418572 Oct 27 13:24:07.389721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 10/18] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:06 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1267 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:07.668789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-932770782", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:07.817541 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] validate_networks() for [('d7787e3c-cdc7-4d31-9969-b3505bdbc01b', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:24:08.402694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:08.403456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:08.437761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:08.443864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:08.444497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:08.449154 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:08.450924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:08.456588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:08.762496 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:08.778632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dc58b47e-bcfb-4816-91eb-410188f7192b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1273 microversion: 2.1 time: 0.380339 Oct 27 13:24:08.783041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 11/19] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:08 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1273 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:09.120168 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1574669790", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "424d9785-78b4-4b32-922b-56a7b3492659"}], "security_groups": [{"name": "tempest-securitygroup--527495886"}], "key_name": "tempest-keypair-768766039", "user_data": "}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:09.474609 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] validate_networks() for [('424d9785-78b4-4b32-922b-56a7b3492659', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:24:11.245993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:24:11.246608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:24:11.247309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:24:11.248032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:24:11.248625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:24:11.265840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:11.267135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:11.268131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:11.269234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:11.271923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:11.272840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:11.309463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:11.315374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for user 97d696ea0031417d8a1a0b8471c26579 and project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:11.355971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:24:11.358856 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:24:11.533774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-44d725f8-5332-4a50-958f-90eb92755615 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.869986 Oct 27 13:24:11.536252 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 9/20] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:24:07 2022] POST /compute/v2.1/servers => generated 383 bytes in 3873 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:24:11.548583 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:11.549285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:11.560374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:11.560872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:11.561308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:11.562085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:11.562476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:11.562900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:11.954342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:24:11.955649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:24:11.956669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:24:11.957293 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:24:11.957904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:24:11.991461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:11.991955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:11.998835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:11.999763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:12.000271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:12.013670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:12.154711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:12.191568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for user 8f0bb483c548429295c02558520c6898 and project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:12.273369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:24:12.300645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:24:12.569543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:12.579687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4e918455-79eb-4040-b15b-483455a4ba9b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.465459 Oct 27 13:24:12.586362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a1c25aae-6ea0-4b9e-ace6-ebb3373f773d tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 1.048910 Oct 27 13:24:12.587568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 12/21] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:24:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 3474 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:24:12.591614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 10/22] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:11 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:12.625537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-eb4949af-0143-4d89-bf0d-a8f671bfc5c3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:12.626174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-eb4949af-0143-4d89-bf0d-a8f671bfc5c3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:12.639807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-10bf946a-256b-4331-a9cc-4c82ca616e13 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:12.640758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-10bf946a-256b-4331-a9cc-4c82ca616e13 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:12.750010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-eb4949af-0143-4d89-bf0d-a8f671bfc5c3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:12.757290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-eb4949af-0143-4d89-bf0d-a8f671bfc5c3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1237 microversion: 2.1 time: 0.148010 Oct 27 13:24:12.757875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 11/23] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:12 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1237 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:12.838625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-10bf946a-256b-4331-a9cc-4c82ca616e13 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:12.847254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-10bf946a-256b-4331-a9cc-4c82ca616e13 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1221 microversion: 2.1 time: 0.256610 Oct 27 13:24:12.870317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 13/24] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:12 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1221 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:13.618761 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:13.620125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:13.626716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:13.627213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:13.627896 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:13.628807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:13.629346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:13.629718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:13.793592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:13.795017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:13.810854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:13.811789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:13.812571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:13.814439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:13.815148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:13.815871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:14.287157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:14.295951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7e2a62c5-9f18-48b2-a03d-d18c7ac931b7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1241 microversion: 2.1 time: 0.518826 Oct 27 13:24:14.301734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 14/25] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:13 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1241 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:14.311966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-443265418", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9e83d77-9944-451b-8320-56a536076101"}], "security_groups": [{"name": "tempest-securitygroup--1369150725"}], "key_name": "tempest-keypair-1285257590", "user_data": "}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:14.644482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] validate_networks() for [('b9e83d77-9944-451b-8320-56a536076101', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:24:15.818450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:15.827985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bd77052c-cf12-4887-acff-2323ea20b04c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 2.212919 Oct 27 13:24:15.845107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 12/26] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:13 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 2231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:15.854619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:15.855318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:15.878727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:15.882986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:15.883444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:15.884183 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:15.884669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:15.885260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:15.959515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:24:15.961640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:24:15.962480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:24:15.963480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:24:15.965292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:24:15.978993 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:15.979825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:15.980512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:15.981718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:15.983219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:15.983807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:15.998742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:16.007137 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:24:16.013408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-779f099b-b713-4a81-9a50-943ba680e0e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.165072 Oct 27 13:24:16.014179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for user e77228bb97fd40dfa311088f28864637 and project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:24:16.016598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 13/27] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:15 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:16.029932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:16.030989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:16.035193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:24:16.038559 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:24:16.045618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:16.058808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:16.059925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:16.066600 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:16.067450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:16.068054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:16.145874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c70437ab-fc96-4030-9db3-5ee736c2a679 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.842991 Oct 27 13:24:16.147643 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 15/28] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Oct 27 13:24:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 1845 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 27 13:24:16.158743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:16.159671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:16.323580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:16.339360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:16.341984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:16.347423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5238646e-5f72-425c-973e-97290d248f93 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1281 microversion: 2.20 time: 0.192457 Oct 27 13:24:16.348053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 16/29] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:16 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1281 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:16.430809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:16.444428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-53e266fa-c366-4547-ba80-41bb2179bf62 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.421783 Oct 27 13:24:16.445775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 14/30] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:16 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:16.861056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:16.862037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:16.868987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:16.890244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:16.890856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:16.891804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:16.892457 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:16.893033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.038795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:17.040165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:17.051439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.051943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.052422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.053124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.060604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.061094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.145291 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.164157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4ff1918e-f872-459b-8fae-1898b2f723f5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.301085 Oct 27 13:24:17.165420 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 17/31] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:16 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:17.301938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.314500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-23143574-29cb-432f-a2cc-1f0cd6596253 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.279427 Oct 27 13:24:17.315258 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 15/32] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:17 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:17.379816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:17.380694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:17.395862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.405362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.406041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.406935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.407543 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.408201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.469173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:17.469797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:17.486535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.487049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.487495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.488216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:17.503807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:17.507504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:17.548646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.561488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.564034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.565554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-059b246e-8273-4dec-8815-b3f74605f81a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.189665 Oct 27 13:24:17.581365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 18/33] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:17 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:17.687121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:17.704523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4d1eb45e-c298-4b29-8a82-dba507a6a8a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.239091 Oct 27 13:24:17.720261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 16/34] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:17 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:18.052345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98d7af89-a551-4c26-bbed-55370b42cdb7", "tag": "c75fe153-8d6a-404a-a659-fc051995130f"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:18.067060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.068294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.068745 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.090813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Creating event network-changed:c75fe153-8d6a-404a-a659-fc051995130f for instance 98d7af89-a551-4c26-bbed-55370b42cdb7 on hv-cinder-86243 Oct 27 13:24:18.091580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 13:24:18.091977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-dc33e8ce-14f7-442e-8a28-1c15760ee855 req-4178757b-d983-4aec-b123-f1d7ca781123 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 13:24:18.093206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.093840 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.094286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.095175 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.095639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.096071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.104736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.compute.rpcapi [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 13:24:18.105705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] Releasing lock "compute-rpcapi-router" {{(pid=118774) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 13:24:18.123391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cedc7e9b-48bd-4b4e-8288-1b9cf7dca236 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.138595 Oct 27 13:24:18.123996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 19/35] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:18.191782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:18.192373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:18.199099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.199604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.200076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.200795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.201250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.202007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.342462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:18.343184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:18.350618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.351321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.351910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.352792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.353398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.353971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.358037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.366010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9aa28cf1-04f8-4d99-b63c-389ab75f8eb7 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.178821 Oct 27 13:24:18.368005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 17/36] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:18 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:18.453537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.462025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-94e03d8d-d039-469c-9e28-607e528dbfc4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.123697 Oct 27 13:24:18.462735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 20/37] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:18 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:18.594115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:18.597351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:18.603725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.604250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.604764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.605609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.606082 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.606514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.714385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.730588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.735483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:18.736119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:18.736921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.740186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9568581e-0bff-4286-acf5-eb821dffc8bc tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.148067 Oct 27 13:24:18.749812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 18/38] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:18 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:18.750205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.750205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.750205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.750205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:18.763767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:18.763767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:18.851994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:18.866372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d584be22-d180-4784-a5e3-2faa2cd232ae tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.138547 Oct 27 13:24:18.867771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 21/39] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:18 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:19.399825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:19.405972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:19.418417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.421149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.423266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.425079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.426189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.427015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.487340 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:19.489212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:19.500983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.515995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.516555 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.517928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.518806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.519411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.660544 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:19.669227 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9a63aaf5-a54b-4d21-9e22-22acee6324d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.186933 Oct 27 13:24:19.670096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 22/40] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:19 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:19.693355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:19.703174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5df023b3-9b80-44f8-8d30-800236f533c0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.310366 Oct 27 13:24:19.712267 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 19/41] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:19 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:19.769015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:19.769623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:19.775825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.776734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.777914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.778617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.779069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.779490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.900057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:19.900932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:19.906212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:19.912503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.913215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.913816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.919058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:19.919745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:19.920346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:19.920991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:19.922886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:19.924050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f5a37087-bfbb-4096-a095-4533e52e99e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.159470 Oct 27 13:24:19.940256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 23/42] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:19 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:20.022989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:20.032750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7d086ca2-ad69-46df-b431-af34a068c385 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.136766 Oct 27 13:24:20.044925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 20/43] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:19 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:20.695519 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:20.696384 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:20.706067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.706738 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.707314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.708317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.708957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.709515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.734558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:20.736022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:20.749285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=9 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:20.751010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.752070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.753274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.761973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.766255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.766255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.798972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:20.806934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ea6628e9-24cd-4f34-9c65-4e91d0d2741b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.115835 Oct 27 13:24:20.807514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 24/44] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:20 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:20.958948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:20.959665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:20.971651 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.978677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.979362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.981051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:20.981665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:20.982097 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:20.994880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.004398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cd264fae-c5a7-446b-9338-774593d2fe77 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.276002 Oct 27 13:24:21.014992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 21/45] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:20 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:21.059412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:21.060146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:21.066818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:21.067401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:21.067948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:21.068745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:21.069435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:21.070158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:21.079460 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.090326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.092708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.094558 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3f721b9e-5f4c-4e76-86b2-8baabd7b9a0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.139690 Oct 27 13:24:21.095623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 25/46] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:20 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:21.142173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.150837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8a1df21e-f69d-420b-8555-c7370eb7c8a7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.096153 Oct 27 13:24:21.151405 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 22/47] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:21 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:21.832135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:21.832791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:21.836012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:21.840312 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:21.840998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:21.841598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:21.842473 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:21.843071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:21.843648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:21.915557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:21.923294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-27e5d0f6-7e65-4567-80ef-6b398fd11cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.095016 Oct 27 13:24:21.923875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 26/48] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:21 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:22.029676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:22.030294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:22.032099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=6 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:22.037363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.037841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.038278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.038964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.039418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.039840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.127716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:22.128361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:22.138868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.139411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.140039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.140997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.148248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.148922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.196459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:22.206660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2fe56913-6412-41f2-853a-f70f927618a3 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.181338 Oct 27 13:24:22.207760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 23/49] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:22 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:22.223778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:22.224476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:22.230598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.231494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.232167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.233021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.233763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.234355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.240796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:22.250459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:22.251900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:22.253083 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-59ad0313-a323-433c-a615-27067510188b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.129251 Oct 27 13:24:22.253652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 27/50] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:22 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:22.300718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:22.308664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1642d77b-db50-43c0-93ba-886c41a5d7b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.099236 Oct 27 13:24:22.309218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 24/51] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:22 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:22.946085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:22.946889 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:22.957389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.957892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.958362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:22.959069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:22.960314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:22.960687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.086139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.099194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8777ad51-3b8b-481a-ba55-d4d200674429 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.156765 Oct 27 13:24:23.100501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 28/52] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:22 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:23.230414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:23.231891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:23.243794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=24 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:23.246459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.247065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.247700 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.248502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.249358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.249869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.280208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:23.281100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:23.285460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:23.293149 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.300927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.301765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.302732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.303397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.304105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.310867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:23.413254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.423604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.425378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.426703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-89eae450-e57d-4b81-9609-db66115b308b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.151908 Oct 27 13:24:23.442383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 29/53] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:23 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:23.454632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.462931 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a3d1560d-612c-4719-a361-f31d82e38fb4 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.236921 Oct 27 13:24:23.466148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:23.467015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:23.474620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.475410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.476057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.476645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 25/54] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:23 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:23.477231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:23.477895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:23.478525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:23.548500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:23.568740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0f663481-2845-48e1-8d4f-7f8e2f1b7866 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.114576 Oct 27 13:24:23.569327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 30/55] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:23 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:24.123364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:24.123973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:24.129839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.130313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.130741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.131425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.131904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.132349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.196618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.204010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a2ac34d8-8f23-4848-901c-fccddcdffb08 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.085325 Oct 27 13:24:24.204616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 26/56] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:24 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:24.460375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:24.460988 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:24.466851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.467328 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.467757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.468464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.468911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.469608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.486271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:24.486882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:24.492563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.493037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.493463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.494147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.494593 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.495008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.530072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.538363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.539817 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.540967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-848d7217-e779-43ed-b397-d3aeee7dc424 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.084550 Oct 27 13:24:24.541522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 31/57] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:24 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:24.592437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:24.593059 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:24.599685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.600174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.600637 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.601335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:24.601783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:24.602203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:24.666749 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.676198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ec31e6cd-2b1a-4d4e-9551-3c94419b10e3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.087676 Oct 27 13:24:24.676804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 32/58] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:24 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:24.779131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:24.786579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-853346cd-ce9a-48e8-b859-6fc6e080987c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.304035 Oct 27 13:24:24.787134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 27/59] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:24 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:25.226211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:25.226910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:25.233510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.234019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.234587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.235323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.235923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.236393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.300192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.307791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7cf5cfdb-4243-43b3-bd3f-d0817bf05d4f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.085402 Oct 27 13:24:25.308397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 33/60] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:25 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:25.565703 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:25.566255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:25.572140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.572664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.573099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.573787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.574241 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.574665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.634191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.642373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.643819 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.644948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-35a14fcb-9948-4dc8-9c5c-4b411016455c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1285 microversion: 2.20 time: 0.083154 Oct 27 13:24:25.645511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 28/61] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:25 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:25.699346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:25.699963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:25.705901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.706386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.706822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.707514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.707969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.708430 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.770951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.779052 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-82f09c5c-1207-4e30-a723-b1729ede03f2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.083466 Oct 27 13:24:25.779612 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 34/62] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:25 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:25.810152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:25.810762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:25.816607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.817025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.817476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.818151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:25.818596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:25.819010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:25.945079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:25.953188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-abefacfd-5eed-4cbd-b1f9-3aaa0ee47fa1 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.147347 Oct 27 13:24:25.953740 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 29/63] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:25 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:26.333867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:26.334825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:26.346809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=26 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:26.352069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.353131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.362348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.362348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.362348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.362348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.476327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:26.486314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5157984a-c609-4db6-bed8-ad04ac69d687 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1281 microversion: 2.1 time: 0.159716 Oct 27 13:24:26.487542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 35/64] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:26 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:26.669726 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:26.670338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:26.676358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.676845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.677275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.677961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.678659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.679415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.802617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:26.803314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:26.809990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.810714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.811311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.812131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.813018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.813554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.814325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:26.825393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:26.826921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:26.828425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d8bbf645-704a-42f7-a90f-d174d224609f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1277 microversion: 2.20 time: 0.162712 Oct 27 13:24:26.828985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 30/65] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:26 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1277 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:26.884800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:26.893639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c85ff41d-4c3b-4fb3-a4f5-57a7f6a4a03b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.095701 Oct 27 13:24:26.894659 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 36/66] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:26 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:26.975367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:26.975976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:26.982663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.983138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.983565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:26.984269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:26.984739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:26.985142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.298217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:27.306757 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-429b66ff-6644-4586-ae41-aba916bcb7ea tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.335112 Oct 27 13:24:27.307421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 31/67] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:26 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:27.509646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:27.510525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:27.516825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.517304 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.518075 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.518771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.519209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.519664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.602726 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2", "tag": "d002aeca-8ed9-4dcb-a918-f911694d6cb8"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:27.625422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.625997 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.626648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.673352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Creating event network-changed:d002aeca-8ed9-4dcb-a918-f911694d6cb8 for instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 on hv-cinder-86243 Oct 27 13:24:27.674734 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=118773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 27 13:24:27.675362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-92fcc1fe-4fb2-4ad7-9ea4-901e34f4c943 req-5fc83a0e-2c98-4e3d-b964-6427807f3a9b service nova] Acquired lock "compute-rpcapi-router" {{(pid=118773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 27 13:24:27.683860 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.684736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.685342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.686168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.686771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.687335 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.707201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.compute.rpcapi [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 27 13:24:27.710709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] Releasing lock "compute-rpcapi-router" {{(pid=118773) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 27 13:24:27.751146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4977a27e-07c9-4633-84c4-5ec491e8bb06 None None] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151776 Oct 27 13:24:27.754114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 32/68] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:27.772080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:27.781019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e9531ef5-831d-4857-99c2-50dcecf0dbe1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.275108 Oct 27 13:24:27.793792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 37/69] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:27 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:27.855357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:27.856059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:27.862785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.863322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.863762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.864523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.864973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.865395 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.916477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:27.917406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:27.924260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.924846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.925432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.926244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:27.926807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:27.927458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:27.937873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:27.946449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:27.949702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:27.950855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-683b7389-4523-4f14-9a48-d14de315fb70 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1277 microversion: 2.20 time: 0.100076 Oct 27 13:24:27.956701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 33/70] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:27 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1277 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:28.003913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:28.012720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9c68106e-4f57-4aa2-b4f5-530baa115cb6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.100128 Oct 27 13:24:28.013417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 38/71] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:27 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:28.331693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:28.332249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:28.338192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.338670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.339106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:28.339788 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.340681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:28.632864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:28.644687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-198ec5dd-0519-4463-8fd6-d0c7b6a990be tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.317110 Oct 27 13:24:28.645711 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 34/72] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:28 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:28.805455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:28.806068 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:28.807864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=6 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:28.813379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.813861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.814289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:28.814979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.815422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.815840 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:28.953188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:28.961103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a456d220-7148-485f-9e7d-e025b3df0339 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.159565 Oct 27 13:24:28.961767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 39/73] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:28 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:28.977852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:28.978543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:28.985058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.985644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.986151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:28.986841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:28.987291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:28.987705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.035243 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:29.036011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:29.042287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.043763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.044633 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.045444 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.046094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.046722 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.052836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:29.061535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:29.063014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:29.065000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-35a5ee71-60b9-48ec-9e36-44f9f25cdcb5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1277 microversion: 2.20 time: 0.091067 Oct 27 13:24:29.065562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 35/74] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:28 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1277 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:29.129390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:29.139724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-85a1a094-3b42-4db2-904f-441d68a1d43e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1289 microversion: 2.1 time: 0.108525 Oct 27 13:24:29.153390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 40/75] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:29 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1289 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:29.680680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:29.681207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:29.687899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.688420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.688851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.689540 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.689988 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.690407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.872778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:29.882326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-12f5f323-9e5e-44d5-ae32-6e6125b92ace tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.205104 Oct 27 13:24:29.882478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 36/76] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:29 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:29.985140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:29.985633 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:29.991540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.992028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.992496 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:29.993194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:29.993658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:29.994164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.090813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:30.091542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:30.101119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.101784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.102367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.103483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.103851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.104594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.133774 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:30.143528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5e89b42c-ec57-4211-bc4b-be41ed058ddb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.162411 Oct 27 13:24:30.144482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 41/77] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:29 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:30.164002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:30.164684 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:30.171145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.171699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.172338 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.172980 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.173509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.173960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.198642 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:30.211972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:30.213448 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:30.214813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c810e783-5349-42bc-8f15-9ebf2a03f736 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1333 microversion: 2.20 time: 0.127836 Oct 27 13:24:30.224657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 37/78] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:30 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1333 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:30.230760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f7d6c5-b670-4c5c-a8b2-87019f4b20f1", "tag": "9d6eda8e-42f9-41c1-9452-42995d1ecd56"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:30.241493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.245600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:30.257174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.257999 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.261400 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-72d1e2a7-a29f-458b-9c94-59e4bfd6b7de tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1295 microversion: 2.1 time: 0.100345 Oct 27 13:24:30.272294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 42/79] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:30 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:30.273977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] Creating event network-changed:9d6eda8e-42f9-41c1-9452-42995d1ecd56 for instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 on hv-cinder-86243 Oct 27 13:24:30.279714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-5d5668c0-0f29-43c0-b8c1-a1ed7aa22d2d req-b2dc84b2-c737-460a-8f26-6b08b03795f2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053506 Oct 27 13:24:30.280313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 38/80] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:30.905662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:30.906270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:30.912128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.912639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.913070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:30.913750 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:30.914198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:30.914615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.040585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.048179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bf112f89-0d74-4f6e-8e9e-1dc1ee52922f tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.146850 Oct 27 13:24:31.048772 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 43/81] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:30 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:31.166680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:31.167400 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:31.173408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.173880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.174307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.175006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.175454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.175869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.251128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:31.251744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:31.257683 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.258172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.258604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.259288 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.259739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.260159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.306638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.315802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3556423a-299b-4641-a4e1-336914b7ab58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.153214 Oct 27 13:24:31.316410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 39/82] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:31 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:31.329062 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.339198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.340699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.341800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ddb6bbf2-5a38-41d0-bd6e-d37e13181b16 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1333 microversion: 2.20 time: 0.094675 Oct 27 13:24:31.342610 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 44/83] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:31 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:31.348798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:31.349416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:31.355459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.355949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.356418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.357287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:31.357736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:31.358155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:31.421485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:31.428963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6995ecdc-d4ea-4479-96a6-e5c84bc11562 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1295 microversion: 2.1 time: 0.098641 Oct 27 13:24:31.429526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 40/84] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:31 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1295 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:32.071271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:32.071644 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:32.078014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.078494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.078923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.079620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.080074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.080519 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.305599 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.309600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:32.314264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d4057a82-5810-46a8-a4b2-15df1ab4467e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.247208 Oct 27 13:24:32.314847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 45/85] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:32 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:32.343277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:32.344026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:32.352386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.352862 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.353297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.354061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.354515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.355475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.367333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:32.367935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:32.374800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.375285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.375714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.376445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.376932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.377323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.478594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.489388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.491670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.493908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ba4df5b7-cad6-4be3-97b1-12d0b1e980ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1333 microversion: 2.20 time: 0.130728 Oct 27 13:24:32.495172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 46/86] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:32 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1333 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:32.500515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:32.501547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:32.508144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.509673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.510736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.512512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:32.513205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:32.513799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:32.786212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.793868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8234b10a-2d40-4cce-bd7a-966a66155c40 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.454607 Oct 27 13:24:32.794519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 41/87] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:32 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:32.831237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:32.838814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fa860623-2033-4557-a212-63345c8b3180 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1295 microversion: 2.1 time: 0.341715 Oct 27 13:24:32.839325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 47/88] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:32 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1295 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:33.338657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:33.339828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:33.345684 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.346208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.346581 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.347265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.347719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.348142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.506885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:33.514684 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a3d8beac-6e8b-4fb8-af0a-bd746544f53a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.179755 Oct 27 13:24:33.515253 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 42/89] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:33 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:33.522727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:33.523520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:33.533948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.534545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.534982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.535991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.537329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.537771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.609376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:33.625536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:33.627236 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:33.633869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8bc4fe47-9205-4f36-ac9a-432bf159baab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1351 microversion: 2.20 time: 0.114699 Oct 27 13:24:33.644490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 48/90] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:33 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1351 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:33.816851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:33.817469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:33.823210 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.824214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.824663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.825397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.825847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.826265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.831057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:33.861400 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:33.862181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:33.869908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.869908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.869908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.870155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:33.870691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:33.871172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:33.962322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:33.970610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7b617fdf-0d8c-44cf-87f0-cfc936d2d3ab tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.157498 Oct 27 13:24:33.971188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 43/91] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:33 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:34.053872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:34.062371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-523f689e-1b3c-4c3b-93f9-679384293a58 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.204789 Oct 27 13:24:34.063015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 49/92] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:33 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:34.539228 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:34.540015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:34.547728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:34.548421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:34.548975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:34.549786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:34.550392 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:34.550822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:34.661958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:34.662576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:34.669167 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:34.669659 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:34.670091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:34.670793 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:34.671253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:34.671678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:34.699599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:34.707651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c6e78fc6-1af5-4ee7-a75e-9d018b76d11b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.174221 Oct 27 13:24:34.708279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 44/93] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:34 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:34.739668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:34.748176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:34.749631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:34.750728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-24062e47-5ea7-433a-9099-c7bb245aed1e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1351 microversion: 2.20 time: 0.092706 Oct 27 13:24:34.751281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 50/94] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:34 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:34.993796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:34.994339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:35.000094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.000677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.001106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.001792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.002237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.002657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.085413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:35.086023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:35.092266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.092759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.093299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.093879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.094326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.094748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.144692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.153413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7a87a2c4-0fe0-429d-a20b-4c7df1b4433a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.163559 Oct 27 13:24:35.153984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 45/95] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:34 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:35.388259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.396902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a6a3e4cb-7623-4920-a617-d580295e4e0b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.315025 Oct 27 13:24:35.409404 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 51/96] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:35 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:35.730964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:35.732280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:35.739974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.740539 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.742730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.743713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.749285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.749801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.780958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:35.782415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:35.791256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.792104 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.793143 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.794183 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:35.794787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:35.795478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:35.938768 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.947301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.954285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.955661 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-89ff4b98-0fc2-485c-a82d-6a3347cb9d3f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1339 microversion: 2.20 time: 0.183549 Oct 27 13:24:35.968276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 52/97] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:35 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1339 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:35.980696 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:35.991701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e7f64ab9-ec2a-4143-8022-4104c585e5f0 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.265326 Oct 27 13:24:36.004423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 46/98] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:35 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:36.176432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:36.177051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:36.183599 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.184375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.184819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:36.185527 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.185980 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.186402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:36.423786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:36.424447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:36.430463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.430953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.431449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:36.432150 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.432627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.433259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:36.585741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:36.595370 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-705153c1-5cbf-4854-bc51-ae71273ed0be tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.175432 Oct 27 13:24:36.611982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 47/99] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:36 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:36.617272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:36.627350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c9995bb1-35c5-435e-8057-67906b4f291d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.454663 Oct 27 13:24:36.628413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 53/100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:36 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:36.988765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:36.989374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:36.995279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.995765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.996196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:36.997146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:36.997774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:36.998371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.017192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:37.017813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:37.034751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.034751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.035218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.036084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.036833 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.037261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.155104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.163123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.164572 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.166255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-418eb635-f55e-4971-8291-d347c7066728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.181343 Oct 27 13:24:37.167104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 48/101] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:36 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:37.199126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.207371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1103853b-2456-435b-83b6-ac4fc702b938 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.195264 Oct 27 13:24:37.208061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 54/102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:37 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:37.301855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91179d4-4294-46cc-b7c1-6aaf60a1ef45", "tag": "1df93e0f-5e21-4eff-a002-553c25504efd"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:37.311537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.312000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.312456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.324445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] Creating event network-changed:1df93e0f-5e21-4eff-a002-553c25504efd for instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 on hv-cinder-86243 Oct 27 13:24:37.329929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-060cf935-c42e-4f7a-90ef-6a87504a3186 req-95348a91-72d2-492c-bf51-b0e44ec65f4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161104 Oct 27 13:24:37.330527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 49/103] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:37.622200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:37.622992 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:37.629248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.629770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.630434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.631173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.631671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.632160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.651385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:37.652084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:37.662859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.663350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.675691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.679226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:37.679880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:37.680325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:37.707480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:37.785907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.794522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bf0da36e-dad0-476d-ae3d-83a4578adef2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.176715 Oct 27 13:24:37.795087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 55/104] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:37 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:37.833957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:37.842161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-585330bb-6577-4b24-bc21-9523cb55211b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.194874 Oct 27 13:24:37.842749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 50/105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:37 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:38.192340 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:38.193073 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:38.199470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.199954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.200516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.201669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.201669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.202074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.230979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:38.232627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:38.243313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.254272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.255018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.256074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.256562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.257741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.611064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:38.626924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:38.631221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:38.632927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f0e33aba-cc22-4a62-9ca8-99165cb2b58a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.444535 Oct 27 13:24:38.633961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 56/106] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:38 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:38.766157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:38.777608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-25905f9d-8da6-4505-93c7-b06e0a1aa1d5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.551143 Oct 27 13:24:38.780109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 51/107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:38 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:38.820339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:38.821883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:38.842989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.843565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.844008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.844762 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.846049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.846649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.864913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:38.865714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:38.875041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.881302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.882197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:38.883172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:38.883830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:38.884476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:39.168675 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.178387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.179868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-26fa41cd-50c8-487c-b6d2-f489d9665c55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.364492 Oct 27 13:24:39.180844 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 57/108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:38 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:39.189080 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e01c0d84-3fed-4eb6-93cf-7fdc7609a32f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.326869 Oct 27 13:24:39.190083 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 52/109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:38 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:39.660026 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:39.660755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:39.668269 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:39.669161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:39.669600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:39.670883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:39.671517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:39.672117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:39.806548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:39.807333 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:39.814425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:39.815146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:39.815647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:39.816448 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:39.817143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:39.817696 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:39.946445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.964837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.966357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.977733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-95915f80-d841-4894-a666-3b83a95771aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.312702 Oct 27 13:24:39.978359 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 58/110] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:39 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:39.985136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:39.991256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:39.998815 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:39.999274 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:39.999821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:40.004451 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ecb19125-09da-4436-93ef-55df4966a078 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.202089 Oct 27 13:24:40.005048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 53/111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:39 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:40.014523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] Creating event network-changed:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:24:40.021442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-8d819106-c537-451a-a8ba-81580ca469c1 req-f867fcda-f8af-4e32-9043-06ede97ed648 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040718 Oct 27 13:24:40.022394 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 59/112] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:40.205158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:40.205980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:40.211884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:40.212408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:40.212848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:40.213543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:40.214039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:40.214463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:40.217656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:40.218596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:40.225069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:40.225552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:40.226166 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:40.227154 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:40.227831 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:40.229714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:40.457958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:40.471849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9233cfc5-b1f9-41ea-a0eb-b6983a8af49d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.270528 Oct 27 13:24:40.475394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 54/113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:40 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:40.757553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:40.766262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bb6bddc0-9f62-4f22-a3c6-c86940cdaa87 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.554594 Oct 27 13:24:40.773859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 60/114] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:40 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:41.003858 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:41.004743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:41.014339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.016132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.017362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.020006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.022842 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.023359 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.031539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:41.032266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:41.043128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.050911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.057267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.058264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.059712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.060618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.290667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:41.299225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:41.300674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:41.303503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-791bec65-0e88-4b0b-b1e6-d8726c8620a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.304054 Oct 27 13:24:41.304065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 55/115] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:40 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:41.348150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:41.356111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ba7ed84e-cfad-43b5-b5f3-ecc1c851d239 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.328661 Oct 27 13:24:41.358242 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 61/116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:41 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:41.497360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:41.498369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:41.507758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.508269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.508705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.509396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.509843 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.511037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.663782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:41.674012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-884cbda6-563c-4726-853b-4c5c903ec5bc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.180657 Oct 27 13:24:41.674908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 56/117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:41 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:41.798217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:41.799495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:41.805390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.805784 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.806211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:41.806947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:41.807927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:41.808608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.107472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.121178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7776054f-998e-4387-baa1-bf23d239b824 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.325389 Oct 27 13:24:42.139996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 62/118] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:41 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:42.336335 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:42.338025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:42.359730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.360514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.361096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.363311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.366029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.366654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.386518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:42.387595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:42.415266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.416129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.417348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.426471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.429311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.433706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.504067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:42.710002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.720948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.729553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.731711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4b58af8a-d0b0-4698-9ca6-4bc37f1a1da5 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.353912 Oct 27 13:24:42.733472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.734628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 63/119] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:42 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:42.739219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8b8bc11a-87a3-4a4e-82f3-7ab36875da15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.408677 Oct 27 13:24:42.739812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 57/120] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:42 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:42.741819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:42.742568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:42.750673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.751472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.752524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.753481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:42.754124 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:42.754739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:42.978475 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:42.987028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2b0a809a-0795-49a6-9b69-99dd2bbc6c25 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.250899 Oct 27 13:24:42.987594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 64/121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:42 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:43.163568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:43.164959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:43.187416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.188321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.190131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.194105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.195209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.197410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.482393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d7af89-a551-4c26-bbed-55370b42cdb7", "name": "network-vif-plugged", "status": "completed", "tag": "c75fe153-8d6a-404a-a659-fc051995130f"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:43.525909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.526683 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.527801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.562926 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] Creating event network-vif-plugged:c75fe153-8d6a-404a-a659-fc051995130f for instance 98d7af89-a551-4c26-bbed-55370b42cdb7 on hv-cinder-86243 Oct 27 13:24:43.604126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-df568c12-1f05-472c-8415-c789d75f989e req-29488f86-485d-44c1-b220-b6129c1d4790 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.279631 Oct 27 13:24:43.609329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 65/122] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:43.633752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:43.648502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8937750a-fb28-4908-867e-c0c447ce97c8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.502339 Oct 27 13:24:43.649549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 58/123] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:43 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:43.766244 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:43.766928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:43.777220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.779876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.780120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:43.781698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.782776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:43.784442 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.785377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.787551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.808949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.819553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.827019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:43.833201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:43.836028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:43.836529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:44.070051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.078111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5ad12a42-29c0-4574-99f5-dd89a59b9f9c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.322876 Oct 27 13:24:44.079002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 66/124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:43 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:44.084079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:44.085308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:44.091686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:44.092823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:44.093409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:44.094985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:44.095584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:44.096298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:44.105212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.114825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.118380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.120600 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-47a1ef9d-0e3e-41c6-86aa-3eb1703d8876 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.357696 Oct 27 13:24:44.121750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 59/125] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:43 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:44.273664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.283029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-93847f48-7666-497c-a274-b4ad9f1d2921 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.202656 Oct 27 13:24:44.283645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 67/126] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:44 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:44.673494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:44.674527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:44.680952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:44.681674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:44.682824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:44.683830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:44.684598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:44.685280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:44.708304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:44.848832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:44.858241 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5fac39d0-df39-4aef-813e-92caf97035cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.188681 Oct 27 13:24:44.858813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 60/127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:44 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:45.102002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:45.103471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:45.110743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.111548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.112047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.113137 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.113777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.114472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.148287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:45.148939 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:45.155493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.156378 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.156958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.157990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.158591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.159164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.318221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:45.326406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a25680b6-b7a4-4cad-a580-a1c8bf42951e tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.229606 Oct 27 13:24:45.333821 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:45.340421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 68/128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:45 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:45.344289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:45.345723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:45.346824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4184646d-767c-4b7e-aee8-34318cfe3f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.203112 Oct 27 13:24:45.347352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 61/129] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:45 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:45.360364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:45.360364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:45.360364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.360754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.361264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.361968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.362652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.363017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.509263 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:45.517718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a0c98571-1b13-43e0-b695-a9bb41be64cd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.175946 Oct 27 13:24:45.518362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 69/130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:45 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:45.881496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:45.882111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:45.889509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.890225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.890678 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:45.891382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:45.891833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:45.892274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.025871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.034138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-eb8f1106-b437-43f1-aa21-abde1a48387e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.156466 Oct 27 13:24:46.034795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 62/131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:45 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:46.355396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:46.356119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:46.362522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.363089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.363597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.364403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.364949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.365384 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.372432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:46.372979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:46.379290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.380368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.380368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.381782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.381903 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.382276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.505189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.513936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-63710b05-c7a4-4b83-99d0-b8f8c545f83b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.162882 Oct 27 13:24:46.514744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 70/132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:46 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:46.519175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.527694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.529152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.530245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d5963f00-a1ba-4191-9e98-794d35267a6e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.161826 Oct 27 13:24:46.530791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 63/133] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:46 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:46.541043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:46.541787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:46.547655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.548212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.548979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.549712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:46.550160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:46.550587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:46.684820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:46.692553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9cafbc09-525f-4fd4-b8a4-ea507ea34e14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.155224 Oct 27 13:24:46.693244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 71/134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:46 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:47.060589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:47.060589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:47.077184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.077883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.078402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.079256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.079789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.080305 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.320171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.338176 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-84c3b066-c0e1-46ca-afb7-059e673b83ea tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.283154 Oct 27 13:24:47.345916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 64/135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:47 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:47.537753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:47.538377 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:47.544931 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.552588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.555003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.555859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.556303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.556780 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.557592 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:47.558348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:47.564909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.565481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.565946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.566700 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.567223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.567710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.708698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.720882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-76cf4fab-1c91-4e6d-aaaa-df3065bff78b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.187160 Oct 27 13:24:47.721482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 72/136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:47 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:47.727398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:47.728816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:47.736608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.737370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.737974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.738691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.739309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.739739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.881287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.890516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5b580d99-f0ae-49aa-8d79-d3e0bebdddf9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.167633 Oct 27 13:24:47.891440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 73/137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:47 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:47.896257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f7d6c5-b670-4c5c-a8b2-87019f4b20f1", "name": "network-vif-plugged", "status": "completed", "tag": "9d6eda8e-42f9-41c1-9452-42995d1ecd56"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:47.907237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:47.908098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:47.908827 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:47.923662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] Creating event network-vif-plugged:9d6eda8e-42f9-41c1-9452-42995d1ecd56 for instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 on hv-cinder-86243 Oct 27 13:24:47.930813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-8886a220-6f65-4e47-b944-23ee8a354210 req-3d40341f-611f-4f0f-8e3d-2cecbdd94858 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037576 Oct 27 13:24:47.931761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 74/138] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:47.957346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.966259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.967823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:47.969153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-86e0eab7-cc51-4063-abbb-bf04f89eb592 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.417018 Oct 27 13:24:47.985423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 65/139] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:47 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:48.372612 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:48.373691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:48.382617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.383389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.384196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.386094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.386954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.388701 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.589495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:48.602697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1afee224-5d19-4013-a7bc-9c3dd049090f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.236556 Oct 27 13:24:48.603461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 75/140] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:48 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:48.746709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:48.747987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:48.754814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.755525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.756114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.756922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.757561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.759079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.915693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:48.916657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:48.922334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:48.925122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.925806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.926522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.927409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:48.928382 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:48.928992 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:48.984104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:48.992349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a9a2a967-117c-4a35-837f-825ac11749b2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1315 microversion: 2.1 time: 0.250483 Oct 27 13:24:48.993577 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 66/141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:48 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1315 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:49.004610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:49.007311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:49.015469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:49.016315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:49.016931 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:49.017698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:49.018366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:49.018892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:49.092621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:49.101574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-88e5cd5f-8bef-43f8-8926-994c7fbd6849 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.190176 Oct 27 13:24:49.117189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 76/142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:48 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:49.191429 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:49.202460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:49.204178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:49.206110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-faa09080-26d3-41a2-950b-93162422f076 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.212258 Oct 27 13:24:49.207098 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 67/143] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:48 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:49.626874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:49.627795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:49.634499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:49.635427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:49.636132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:49.637114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:49.637597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:49.638100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:49.803121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:49.811792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-00ef5aa9-a707-40e7-bc3d-0619f093a692 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1321 microversion: 2.1 time: 0.188966 Oct 27 13:24:49.824619 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 77/144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:49 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:49.957191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2", "name": "network-vif-plugged", "status": "completed", "tag": "d002aeca-8ed9-4dcb-a918-f911694d6cb8"}, {"server_uuid": "a91179d4-4294-46cc-b7c1-6aaf60a1ef45", "name": "network-vif-plugged", "status": "completed", "tag": "1df93e0f-5e21-4eff-a002-553c25504efd"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:49.976984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:49.977772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:49.978426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.004934 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Creating event network-vif-plugged:d002aeca-8ed9-4dcb-a918-f911694d6cb8 for instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 on hv-cinder-86243 Oct 27 13:24:50.009093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] Creating event network-vif-plugged:1df93e0f-5e21-4eff-a002-553c25504efd for instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 on hv-cinder-86243 Oct 27 13:24:50.015978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:50.016673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:50.029110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.029307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-fce73cbb-23a7-465f-a35e-05957ecfc9d9 req-598e8891-3514-48eb-b31b-13e8ab276fa8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.076062 Oct 27 13:24:50.032329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.032845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 68/145] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:50.033638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.038122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.039218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.040387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.127856 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:50.128692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:50.137550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.138329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.139044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.141034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.142088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.143508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.220060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:50.228825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-98e0b51a-9570-45f5-bca6-2073356eb9e2 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1503 microversion: 2.1 time: 0.217066 Oct 27 13:24:50.230072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 78/146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:50 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1503 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:50.234835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:50.235607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:50.241957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.242672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.243668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.244647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.245300 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.245925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.322017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:50.337288 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c0ae680e-f0c2-4b20-846f-b3af88b981a9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.213388 Oct 27 13:24:50.337877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 69/147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:50 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:50.494853 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:50.514841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:50.518848 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:50.520302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9322f360-16cb-4783-bf88-61178702d29e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.289258 Oct 27 13:24:50.521571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 79/148] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:50 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:50.835272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:50.836720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:50.846235 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=98 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:50.850353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.850815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.851254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:50.851987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:50.852469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:50.852888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.032641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.040342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-469d23fe-994a-449b-b9ff-1b10d5c93e58 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1515 microversion: 2.1 time: 0.209357 Oct 27 13:24:51.040874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 70/149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:50 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1515 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:51.071187 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:51.074041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:51.081575 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.082064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.082559 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.083351 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.084046 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.084619 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.197719 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'flavor' on Instance uuid 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:24:51.285008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:51.363187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:51.363783 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:51.374989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.375512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.377880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.380302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.382274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.383238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.442321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ff3ea32e-8af3-42bd-b64e-5adb0d84e073 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1/action" status: 200 len: 32 microversion: 2.1 time: 0.376358 Oct 27 13:24:51.444048 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 80/150] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:24:51 2022] POST /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1/action => generated 32 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:24:51.454493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:51.455572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:51.462523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.464504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.465641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.466588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.467247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.467914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.587505 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.599908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bc2f72c8-0de1-42b8-ad23-ab8930f6b91a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1362 microversion: 2.1 time: 0.241321 Oct 27 13:24:51.618231 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 71/151] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:51 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1362 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:51.623452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:51.625981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:51.632074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.632601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.633033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.633723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:51.634352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:51.635698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:51.666099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.674597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6feeba1e-5a9f-4f1b-8b7f-00623f04ccd7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.224186 Oct 27 13:24:51.676297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 81/152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:51 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:51.804547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.813814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.815550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:51.817014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3ebe52f1-0748-4df8-b73d-57b43c253358 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.197675 Oct 27 13:24:51.817811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 72/153] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:51 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:52.019420 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bcd0478a-ba45-4e19-af88-d6d49a57a10f"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:52.022639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:52.031713 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.034130 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.034813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.035758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.036459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.043867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.053658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "name": "network-vif-plugged", "status": "completed", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:52.068618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.069488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.071618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.086443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] Creating event network-vif-plugged:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:24:52.093875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-62663b10-a578-4d26-8ab6-f80c57348fb0 req-9b4936bd-7da3-48ab-bc21-7f640ab5885c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048492 Oct 27 13:24:52.095023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 73/154] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:52.625520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:52.626273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:52.640014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.645428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.645932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.649126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.649781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.650818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.963853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:52.972523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8cf11ea5-4f93-487f-9a58-001fd5c474b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1547 microversion: 2.1 time: 0.351255 Oct 27 13:24:52.975163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 74/155] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:52 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1547 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:52.981962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:52.982847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:52.989465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.990548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.991426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:52.992398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:52.993059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:52.993706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:53.305118 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:53.314158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5e5779be-4f35-4eef-bfc3-a172a0e5a293 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.337239 Oct 27 13:24:53.323844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 75/156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:52 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:53.331452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:53.332218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:53.356981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:53.357679 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:53.358260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:53.360033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:53.364057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:53.364777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:53.373618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a81eb373-a252-458f-a1bd-dfef1767da2a tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "POST /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.356277 Oct 27 13:24:53.376588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 82/157] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:24:52 2022] POST /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7/os-volume_attachments => generated 194 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:53.414433 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:53.417706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:53.452462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:53.455135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:53.456352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:53.457098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:53.457574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:53.458192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:53.594432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a515dbfc-e28b-4128-a3f4-991f32c7977e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.211904 Oct 27 13:24:53.595029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 83/158] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:24:53 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-interface => generated 284 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:53.623155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:53.631749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:53.633221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:53.634335 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-54672e8c-bc6e-4f55-a511-3f0c9c6f7523 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.306679 Oct 27 13:24:53.635899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 76/159] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:53 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:54.350628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:54.351206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:54.358986 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:54.359920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:54.361165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:54.361812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:54.362278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:54.362676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:54.661267 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:54.662555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:54.670383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:54.671290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:54.671890 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:54.672780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:54.673471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:54.674178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:54.927112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:54.942411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:54.956647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:54.958794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6233d52e-800b-4cf0-aee0-92242256d48d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1407 microversion: 2.20 time: 0.302097 Oct 27 13:24:54.959310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 77/160] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:54 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1407 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:24:54.985472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:54.999671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-77c1e369-912c-4cc5-8607-997743beca5f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.656213 Oct 27 13:24:55.001018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 84/161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:54 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:55.785622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a91179d4-4294-46cc-b7c1-6aaf60a1ef45", "tag": "1df93e0f-5e21-4eff-a002-553c25504efd"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:55.801574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:55.803158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:55.805540 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:55.839623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] Creating event network-changed:1df93e0f-5e21-4eff-a002-553c25504efd for instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 on hv-cinder-86243 Oct 27 13:24:55.845180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-831a3dbc-1b51-4f01-9a52-767c83a9debb req-a9b0d068-50a3-4f00-9863-6337170a6c5e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063782 Oct 27 13:24:55.846338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 78/162] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:24:55.992202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:55.993693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:56.002490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.003204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.003810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.005429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.006234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.007400 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.031084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:56.032178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:56.045103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.052957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.055718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.058482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.062380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.063128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.079731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:24:56.434233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:56.446033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f8c9e519-8884-45fb-b208-354eaebaf64c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.420986 Oct 27 13:24:56.448061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 79/163] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:56 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:56.696280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:56.704850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:56.706294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:56.711509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-18f139c1-45c9-4288-b43b-17485d9823b3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1598 microversion: 2.20 time: 0.727211 Oct 27 13:24:56.714835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 85/164] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:24:55 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1598 bytes in 731 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:24:56.747306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:56.748097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:56.758211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.762102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.762102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.762364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:56.767303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:56.768001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:56.976008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-852a6b92-64b3-400f-a81c-5b1d694ea066 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.232548 Oct 27 13:24:56.976996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 80/165] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Oct 27 13:24:56 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-interface => generated 284 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:24:57.473939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:57.474551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:57.488479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:57.490107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:57.491653 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:57.493375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:57.494576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:57.495255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:57.737186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:57.746929 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-abce6dcd-3ab4-45fb-a42c-448169d5ef23 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.279715 Oct 27 13:24:57.764321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 86/166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:57 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:24:58.771113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:24:58.771739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:24:58.779178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:58.779669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:58.780103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:58.780836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:58.781463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:58.782051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:59.042603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:24:59.056786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-64cec508-7add-460c-b09d-b305a5d6e6a2 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.289420 Oct 27 13:24:59.058457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 81/167] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:24:58 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:24:59.073733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:24:59.087030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:24:59.088389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:24:59.088984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:24:59.102386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] Creating event network-changed:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:24:59.111877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-7aea7ac5-9ca0-429b-9c77-4f82ddce43ca req-2cbd6a77-5282-453a-99cb-4875811f052f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056551 Oct 27 13:24:59.114552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 87/168] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:25:00.085816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:00.086563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:00.097800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:00.100717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:00.104262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:00.105153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:00.105684 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:00.106833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:00.342874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:00.352814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-98a45fc1-3121-4418-827e-5e3c0d7ae583 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.271258 Oct 27 13:25:00.354567 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 82/169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:00 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:01.377401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:01.378068 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:01.384079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:01.385216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:01.385651 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:01.386332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:01.386780 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:01.387195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:01.605387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:01.615050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cddb933d-97e3-40d6-a146-ff6a925fb843 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.242364 Oct 27 13:25:01.618599 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 88/170] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:01 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:02.506847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:02.507975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:02.515033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.515517 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.515952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.516686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.517143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.517561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.546929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:25:02.639795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:02.641113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:02.649010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.649510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.649946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.651867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.652358 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.652784 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.686623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0494e2f2-8b47-4193-90bc-e743fca585c6 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 204 len: 0 microversion: 2.1 time: 0.183871 Oct 27 13:25:02.688320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 83/171] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:25:02 2022] DELETE /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:25:02.703621 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:02.704617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:02.714787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.715786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.716805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.717930 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:02.718406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:02.718847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:02.821469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:02.830753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-eb8aeef7-7d5e-4b94-ad24-76289feb46eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.195307 Oct 27 13:25:02.831339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 89/172] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:02 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:02.906880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:02.917609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fd4f9499-2a1f-4daa-955b-5210bf94a64c tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1555 microversion: 2.1 time: 0.219593 Oct 27 13:25:02.918275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 84/173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:02 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1555 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:03.855566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:03.856212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:03.862728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:03.863213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:03.863676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:03.864476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:03.864931 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:03.865352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:03.940204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:03.940843 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:03.949827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:03.950322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:03.950756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:03.951470 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:03.951916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:03.952415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:04.009950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:04.018071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1310ac97-badf-43d1-ae48-4c4d283f39a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.166891 Oct 27 13:25:04.018757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 90/174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:03 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:04.094623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:04.104241 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4e781371-1ece-48f1-aa29-ffb7f2b863da tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1555 microversion: 2.1 time: 0.167052 Oct 27 13:25:04.105213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 85/175] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:03 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1555 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:05.041879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:05.042492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:05.049008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:05.049479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:05.049905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:05.050592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:05.051037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:05.051455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:05.126985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:05.128399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:05.137296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:05.137818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:05.138968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:05.139446 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:05.140120 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:05.140758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:05.191971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:05.200535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a088bbcf-73a9-4fd4-914e-44649c9e6df0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.162438 Oct 27 13:25:05.208288 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 91/176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:05 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:05.611849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:05.622478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-85553293-a7bc-45bf-8be0-064adf182350 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1555 microversion: 2.1 time: 0.499414 Oct 27 13:25:05.624018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 86/177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:05 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1555 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:05.990004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98d7af89-a551-4c26-bbed-55370b42cdb7", "name": "network-vif-deleted", "tag": "c75fe153-8d6a-404a-a659-fc051995130f"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:06.004576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.005287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.006255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.025308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] Creating event network-vif-deleted:c75fe153-8d6a-404a-a659-fc051995130f for instance 98d7af89-a551-4c26-bbed-55370b42cdb7 on hv-cinder-86243 Oct 27 13:25:06.042058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-7035afda-6742-4b51-bc67-99c5114549e8 req-2366d2ec-5c82-482d-9701-f8c28dee968e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057836 Oct 27 13:25:06.042058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 92/178] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:25:06.223000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:06.223631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:06.230925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.231435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.231888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.233030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.233610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.234041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.381857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:06.390595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-677734af-5a43-45db-9d86-446abed37e95 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.171538 Oct 27 13:25:06.391501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 87/179] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:06 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:06.647955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:06.648699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:06.667473 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.668055 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.668540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.669320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.669856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.670433 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.703335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:06.703819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:06.704272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:06.704717 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lazy-loading 'fault' on Instance uuid 98d7af89-a551-4c26-bbed-55370b42cdb7 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:25:06.748438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '24289ae31c444a03b59ca5322f5abff2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cecd3a5ba83e47119462cb9166e9a80a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:06.756869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-41a4f198-31b9-4f31-9101-8301b43c9e63 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 200 len: 1351 microversion: 2.1 time: 0.113747 Oct 27 13:25:06.757547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 93/180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:06 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 1351 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:07.414876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:07.415502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:07.421494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.421977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.422411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.423100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.423556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.423980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.564327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:07.572713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6a6b0102-93bf-41b1-9fe3-500eb7b86e7d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.161053 Oct 27 13:25:07.573208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 88/181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:07 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:07.782663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:07.784196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:07.793024 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.793740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.794272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.794988 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.795449 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.795885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.810152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] HTTP exception thrown: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Request method failure captured: Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 HTTP/1.1 Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZsPe7Pcfz4wagnDOLh2W-FtMd6bO2_Tn3n9ZcDHb5iV_PX-LQ2PnXt90sfiSH21z9hBgJ6ziQ4t2SGzrXcXN4ZYaEdd23SZJfrt4zMh0RRqyz8we_zTdfj2G9xrZBoYa1dNgrOr3J92yLgQs0JNZHDkqYPdoC4sjvrPJ3I1i5u-cE Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:25:07.814814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 24289ae31c444a03b59ca5322f5abff2 Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.816292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '98d7af89-a551-4c26-bbed-55370b42cdb7'} Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:25:07.817196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.818622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:07.819838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Returning 404 to user: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:25:07.819838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c83ea34c-d86e-43d3-9307-d9e2e30c1440 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 404 len: 111 microversion: 2.1 time: 0.038690 Oct 27 13:25:07.819838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 94/182] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:07 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:25:07.963615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:07.965875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:07.973855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.974364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.974979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.975757 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:07.977304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:07.978917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:07.993193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] HTTP exception thrown: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Request method failure captured: Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7/os-volume_attachments HTTP/1.1 Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZsPe7Pcfz4wagnDOLh2W-FtMd6bO2_Tn3n9ZcDHb5iV_PX-LQ2PnXt90sfiSH21z9hBgJ6ziQ4t2SGzrXcXN4ZYaEdd23SZJfrt4zMh0RRqyz8we_zTdfj2G9xrZBoYa1dNgrOr3J92yLgQs0JNZHDkqYPdoC4sjvrPJ3I1i5u-cE Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:25:07.998094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 24289ae31c444a03b59ca5322f5abff2 Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:07.999516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'server_id': '98d7af89-a551-4c26-bbed-55370b42cdb7'} Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:25:08.000319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:08.001574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:08.003383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Returning 404 to user: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:25:08.003886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f3079dcf-510c-45e2-ba1c-abaf03aa7bfb tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.044710 Oct 27 13:25:08.005999 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 89/183] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:25:07 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:25:08.603714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:08.604399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:08.610485 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:08.611035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:08.611541 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:08.612343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:08.612907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:08.613334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:08.750676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:08.760819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d747b213-0ac8-4c25-af58-2883cb45647e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.161445 Oct 27 13:25:08.765144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 95/184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:08 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:09.290206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:09.291316 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:09.297207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.297686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.298114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:09.298827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.299279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.299694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:09.314173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] HTTP exception thrown: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Request method failure captured: Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 HTTP/1.1 Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZsPe7Pcfz4wagnDOLh2W-FtMd6bO2_Tn3n9ZcDHb5iV_PX-LQ2PnXt90sfiSH21z9hBgJ6ziQ4t2SGzrXcXN4ZYaEdd23SZJfrt4zMh0RRqyz8we_zTdfj2G9xrZBoYa1dNgrOr3J92yLgQs0JNZHDkqYPdoC4sjvrPJ3I1i5u-cE Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:25:09.316491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 24289ae31c444a03b59ca5322f5abff2 Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.317877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '98d7af89-a551-4c26-bbed-55370b42cdb7'} Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:25:09.318647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.320070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.321561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Returning 404 to user: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:25:09.321561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4211bc3f-902f-4f0f-a091-1cbadacb75d9 tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "DELETE /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 404 len: 111 microversion: 2.1 time: 0.031605 Oct 27 13:25:09.321561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 90/185] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:25:09 2022] DELETE /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:25:09.329054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:09.329797 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] [instance: 98d7af89-a551-4c26-bbed-55370b42cdb7] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:09.338044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.338529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.338970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:09.339669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.340127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.340607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:09.354793 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] HTTP exception thrown: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Request method failure captured: Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 HTTP/1.1 Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZsPe7Pcfz4wagnDOLh2W-FtMd6bO2_Tn3n9ZcDHb5iV_PX-LQ2PnXt90sfiSH21z9hBgJ6ziQ4t2SGzrXcXN4ZYaEdd23SZJfrt4zMh0RRqyz8we_zTdfj2G9xrZBoYa1dNgrOr3J92yLgQs0JNZHDkqYPdoC4sjvrPJ3I1i5u-cE Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:25:09.356442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_cecd3a5ba83e47119462cb9166e9a80a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: cecd3a5ba83e47119462cb9166e9a80a Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-DeleteServersTestJSON-306112003 Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 24289ae31c444a03b59ca5322f5abff2 Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-DeleteServersTestJSON-306112003-project Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.357761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '98d7af89-a551-4c26-bbed-55370b42cdb7'} Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:25:09.358464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. Oct 27 13:25:09.359687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:25:09.360711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] Returning 404 to user: Instance 98d7af89-a551-4c26-bbed-55370b42cdb7 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:25:09.360711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-deb99a86-e05e-4339-a387-2cae53fd445b tempest-DeleteServersTestJSON-306112003 tempest-DeleteServersTestJSON-306112003-project] 10.222.0.48 "GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7" status: 404 len: 111 microversion: 2.1 time: 0.033531 Oct 27 13:25:09.360711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 96/186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:09 2022] GET /compute/v2.1/servers/98d7af89-a551-4c26-bbed-55370b42cdb7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:25:09.784142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:09.788418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:09.804618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.808062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.808679 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:09.809746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:09.810345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:09.812579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:10.005938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:10.015978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-50cde5c3-691b-48bd-abf5-a196fa622783 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.235909 Oct 27 13:25:10.017029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 91/187] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:09 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:11.041268 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:11.042283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:11.051374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:11.051873 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:11.052339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:11.054624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:11.058240 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:11.058692 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:11.064343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:11.285094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:11.298189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e5dfd739-3a1f-442b-bed4-95e7659a52a9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.261561 Oct 27 13:25:11.299252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 97/188] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:11 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:12.324112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:12.325112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:12.332511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:12.333277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:12.334028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:12.334859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:12.335496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:12.336123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:12.581603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:12.595091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-47bc0606-b685-4d75-a9f7-29018d7a46e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.272046 Oct 27 13:25:12.605163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 92/189] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:12 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:13.620911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:13.621522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:13.655268 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:13.655691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:13.656132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:13.661425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:13.661908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:13.662345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:13.820391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:13.828189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f32ac80f-e30b-41a4-89fc-d262c3054161 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.211089 Oct 27 13:25:13.828787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 98/190] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:13 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:14.850754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:14.851964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:14.859421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:14.859904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:14.860375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:14.861229 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:14.861837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:14.862266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:14.997880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:15.006355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-729aecc9-732c-4f10-bac7-0467fe0b504f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.159442 Oct 27 13:25:15.006913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 93/191] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:14 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:16.030283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:16.030972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:16.037740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:16.038231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:16.038692 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:16.039666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:16.040182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:16.041144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:16.185709 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:16.194014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ef37c8c9-0c2e-49e8-be53-cca072d5e8c5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.167658 Oct 27 13:25:16.194799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 99/192] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:16 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:17.217706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:17.218321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:17.228914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:17.229408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:17.229851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:17.230598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:17.231053 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:17.271017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.025s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:17.539872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:17.564933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-94e10392-e831-4ad0-864b-e89092c9c8ca tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.349744 Oct 27 13:25:17.566048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 94/193] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:17 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:18.593712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:18.594381 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:18.608879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:18.609363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:18.611156 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:18.612766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:18.615256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:18.615840 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:18.915785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:18.923364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b50eeeef-5d94-499d-b25c-60ba8985e8bb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.334545 Oct 27 13:25:18.926913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 100/194] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:18 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:19.957671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:19.958803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:19.965908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:19.966397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:19.966828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:19.969717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:19.970183 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:19.970614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:20.160251 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:20.163722 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:20.171899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-24046277-e07b-4173-9d3f-4c77f8bcd5b9 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.218226 Oct 27 13:25:20.181399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 95/195] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:19 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:20.392940 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ce7604e0-e964-4b6b-9455-e5f97e2c1aff tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: .version_select at 0x7fb3735f90d0>, body: {"keypair": {"name": "tempest-keypair-1671385918", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCf5rMmoIQUp/kksmQp8UAgZKGp2T5FCVMihusUPEqK7Le8TOJEv9fms8Z30ZL5WG+FoeJS5zqJwIP0MhM8AjMt+lP3gjaejEx+2Q7AAU3TvJvTswBewFs72CNeW8afokA=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:20.398595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=51 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:20.411184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-ce7604e0-e964-4b6b-9455-e5f97e2c1aff tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:25:20.416493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-ce7604e0-e964-4b6b-9455-e5f97e2c1aff tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:25:20.446871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ce7604e0-e964-4b6b-9455-e5f97e2c1aff tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.367445 Oct 27 13:25:20.447479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 101/196] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:25:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:21.207961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:21.210625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:21.213724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:21.226420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:21.228003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:21.228723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:21.235098 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:21.240710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:21.241456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:21.540396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:21.550910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cb41e047-83da-4fae-bf71-6afa639be6eb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.356336 Oct 27 13:25:21.557153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 96/197] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:21 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:22.583540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:22.584153 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:22.605902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:22.606388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:22.606853 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:22.607574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:22.608022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:22.618812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:22.887239 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:22.899474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-09cbc0ad-b2ff-41be-b8a0-464bd6178377 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.321230 Oct 27 13:25:22.901513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 102/198] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:22 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:23.827938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1307770467", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4880e921-0c48-45fa-a974-af272c815db4"}], "security_groups": [{"name": "tempest-securitygroup--2046153601"}], "key_name": "tempest-keypair-1671385918", "user_data": "}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:23.925876 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:23.926785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:23.942989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:23.943596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:23.947361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:23.948987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:23.952780 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:23.953298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:24.282380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] validate_networks() for [('4880e921-0c48-45fa-a974-af272c815db4', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:25:24.289146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:24.302120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7b4136ac-527a-4fe8-a64a-8c5a3ed449e3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.380109 Oct 27 13:25:24.325681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 103/199] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:23 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:24.984716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:25:24.985764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:25:24.986929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:25:24.987540 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:25:24.988970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:25:25.001614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:25.002547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:25.003913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:25.005140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:25.005949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:25.006602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:25.030108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:25:25.034507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:25:25.050764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:25:25.053220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:25:25.125245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-de6b59bf-59b3-4ea9-944a-3b230d3db8ba tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.305992 Oct 27 13:25:25.126117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 97/200] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:25:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:25:25.138322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-34de7b18-ef1b-40d0-b537-415c7fde08d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:25.139513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-34de7b18-ef1b-40d0-b537-415c7fde08d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:25.270180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-34de7b18-ef1b-40d0-b537-415c7fde08d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:25.281011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-34de7b18-ef1b-40d0-b537-415c7fde08d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1242 microversion: 2.1 time: 0.147446 Oct 27 13:25:25.282358 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 104/201] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:25 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1242 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:25.333682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:25.334310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:25.351292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:25.351813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:25.352317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:25.355254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:25.355622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:25.356334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:25.645324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:25.666152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0f9e5188-bf3c-4f13-8b96-3d7b217dba05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.336671 Oct 27 13:25:25.682471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 98/202] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:25 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:26.307247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:26.310876 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:26.321133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:26.323189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:26.324833 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:26.327282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:26.327770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:26.328215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:26.420064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:26.432285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a07d640e-bcc7-4561-a0cd-705999a8a359 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1238 microversion: 2.1 time: 0.126881 Oct 27 13:25:26.437530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 105/203] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:26 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1238 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:26.690410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:26.691020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:26.698227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:26.698807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:26.699242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:26.700009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:26.700577 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:26.701002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:26.859809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:26.871067 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2f4ddb47-e780-4879-a858-9ba77205e962 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.183907 Oct 27 13:25:26.872052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 99/204] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:26 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:27.462389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:27.463000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:27.475723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:27.476222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:27.478007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:27.478909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:27.480189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:27.488215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:27.581530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:27.590376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-57fd3c6b-cbd9-4d07-9f31-0798270fe8d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1294 microversion: 2.1 time: 0.132729 Oct 27 13:25:27.591271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 106/205] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:27 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1294 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:27.895233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:27.895888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:27.903786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:27.904388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:27.904890 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:27.905735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:27.906624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:27.907056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:28.049081 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:28.057640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e72ef39a-4fd3-462a-92cf-f452d3e30c1a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1521 microversion: 2.1 time: 0.166431 Oct 27 13:25:28.058272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 100/206] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:27 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:28.616047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:28.618197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:28.629440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:28.632398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:28.633159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:28.635059 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:28.636428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:28.637405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:28.764743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:28.773062 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b5818dec-4250-4044-819f-2904e8f40e13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1294 microversion: 2.1 time: 0.164169 Oct 27 13:25:28.774468 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 107/207] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:28 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1294 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:29.083667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:29.084466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:29.095547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.095547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.095547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.095547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.095869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.095869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.232691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:29.241790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7fdcb948-584e-4ed6-a32e-1293f93185f5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1501 microversion: 2.1 time: 0.163559 Oct 27 13:25:29.243053 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 101/208] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:29 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1501 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:29.265908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:29.266621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:29.272673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.273226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.273919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.274744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.275258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.275689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.442635 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:29.452348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2c7555cc-4c20-48df-b7ba-1aeaa3f46663 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1515 microversion: 2.1 time: 0.190212 Oct 27 13:25:29.452937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 108/209] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:29 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1515 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:29.799982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:29.801192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:29.814088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.814494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.816146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.822855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:29.824057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:29.826249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:29.981122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:29.990347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-624f4202-e6d5-4a06-83bf-8890cf803475 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1300 microversion: 2.1 time: 0.197527 Oct 27 13:25:29.993220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 102/210] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:29 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1300 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:31.017461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:31.021166 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:31.031027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.032896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.035021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.036882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.040729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.041283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.087600 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:31.090200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:31.106394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.109508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.110043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.112198 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.114283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.115781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.191856 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'flavor' on Instance uuid 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:25:31.372675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4a869812-5a9d-445e-ba65-aae9b1900667 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/action" status: 200 len: 32 microversion: 2.1 time: 0.290403 Oct 27 13:25:31.373653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 103/211] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:25:31 2022] POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 13:25:31.379796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8b8230-922c-4d41-90e1-6b62526afc91", "tag": "6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:31.395932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.396819 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.397605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.413171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] Creating event network-changed:6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c for instance 7e8b8230-922c-4d41-90e1-6b62526afc91 on hv-cinder-86243 Oct 27 13:25:31.419645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-b72352e1-2adb-466e-98cd-21429c101ce8 req-7b14ff97-9f89-4b11-a4d0-ab481fc7d8b2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043876 Oct 27 13:25:31.421480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 104/212] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:31.434312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:31.436055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:31.443832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.444668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.446474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.447391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:31.448117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:31.448995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:31.725565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:31.736977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-91e84b13-cc6e-4253-bb4a-139e3a2e2021 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.308351 Oct 27 13:25:31.738474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 105/213] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:31 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:31.746118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:31.761967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2c27db12-baf5-43d0-a5b3-c8596d7f9c4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.749203 Oct 27 13:25:31.762927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 109/214] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:31 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:32.763032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:32.763817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:32.770416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:32.770909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:32.771356 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:32.772055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:32.772727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:32.773151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:32.795664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:32.796816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:32.808585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:32.809111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:32.809888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:32.811122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:32.811935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:32.812403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:33.034948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:33.050079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f3495a5b-af17-4e33-b14f-d552d4a2a20e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.257681 Oct 27 13:25:33.051032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 110/215] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:32 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:33.108629 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:33.137897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-345716f9-715f-43cb-9767-92ce111393b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.380785 Oct 27 13:25:33.141139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 106/216] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:32 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:34.073719 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:34.074339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:34.080900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.081378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.081805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.082817 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.083273 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.083696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.172667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:34.173283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:34.179203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.180142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.180622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.181311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.181968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.182398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.265304 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:34.288008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-70e89fdf-af21-4802-bdd6-a30a0d9379aa tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.218489 Oct 27 13:25:34.304180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 111/217] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:34 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:34.321517 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:34.331200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6d02566a-fbbb-4140-8e4b-5a265c5ce8ce tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.162152 Oct 27 13:25:34.332399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 107/218] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:34 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:34.408895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1710547837", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:34.463731 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] validate_networks() for None {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:25:34.791499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:25:34.791985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:25:34.792566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:25:34.793605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:25:34.794084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:25:34.806192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.806679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.807146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.808111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:34.808752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:34.809382 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:34.829517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Getting quotas for project ad0ac3d8983248bcad9b84c1be67bc47. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:25:34.834010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Getting quotas for user e89e34bc3817448d93d576348bd346de and project ad0ac3d8983248bcad9b84c1be67bc47. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:25:34.858595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:25:34.858595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:25:34.908693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a68f6d75-dcb1-468d-9c06-8a1f6403133c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.502328 Oct 27 13:25:34.908693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 112/219] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:25:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:25:34.919273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6a70b1fd-f569-436e-aa49-25b57ac3b43e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:34.919896 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a70b1fd-f569-436e-aa49-25b57ac3b43e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:34.983519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6a70b1fd-f569-436e-aa49-25b57ac3b43e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:34.993022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6a70b1fd-f569-436e-aa49-25b57ac3b43e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1215 microversion: 2.1 time: 0.076021 Oct 27 13:25:35.001168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 108/220] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:34 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1215 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:35.313746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:35.314380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:35.328209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:35.328743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:35.329200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:35.330046 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:35.330550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:35.331151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:35.358138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:35.359720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:35.370941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:35.373785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:35.374955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:35.376287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:35.377389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:35.378135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:35.379076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:35.558818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:35.566889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8c0619ff-7fb9-47df-988a-fae5fda81c19 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.215862 Oct 27 13:25:35.571125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 109/221] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:35 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:35.577521 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8b8230-922c-4d41-90e1-6b62526afc91", "name": "network-vif-plugged", "status": "completed", "tag": "6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:35.611174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:35.611696 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:35.612599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:35.628384 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:35.639449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] Creating event network-vif-plugged:6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c for instance 7e8b8230-922c-4d41-90e1-6b62526afc91 on hv-cinder-86243 Oct 27 13:25:35.644589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-6ef6b7aa-6a94-46e2-b25a-44a8254d0feb req-7574b423-ce28-4440-9a6c-0497b6f6b85b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070411 Oct 27 13:25:35.645186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 110/222] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:35.646088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-00f67901-4bc2-4b4c-89da-c5470f11a1be tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.335875 Oct 27 13:25:35.647218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 113/223] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:35 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:36.015476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:36.016188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:36.022233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.022744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.023303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.023962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.024454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.024882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.088275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:36.095834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-323522fe-60d0-4945-9bd8-14b0b0fdef9e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1219 microversion: 2.1 time: 0.084507 Oct 27 13:25:36.096598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 111/224] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:36 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:36.599799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:36.600486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:36.606808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.607292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.607728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.608460 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.608918 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.609516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.670302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:36.670910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:36.677204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.677868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.678517 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.680339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:36.681023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:36.681510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:36.747759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:36.756407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-35dd31d5-36f0-4073-b25d-778909cbb8b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.160430 Oct 27 13:25:36.757001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 114/225] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:36 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:36.827878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:36.835620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ed7d1cfc-ce9f-4b08-a7ac-7135ef4dde1f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.169121 Oct 27 13:25:36.836224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 112/226] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:36 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:37.120896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:37.121548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:37.127695 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.128407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.128850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.129549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.130008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.130430 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.192372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:37.202030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-95e9bd82-7e51-43b5-97f4-f3a762a1c2df tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1219 microversion: 2.1 time: 0.085481 Oct 27 13:25:37.203138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 115/227] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:37 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:37.779441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:37.780304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:37.786459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.787009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.787569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.788643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.790089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.790933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.811422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:37.860537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:37.861313 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:37.868086 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.868674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.869577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.870365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:37.870878 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:37.871542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:37.897194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:37.982848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:37.990887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f4762565-1984-4bc1-a92d-c972fa5e1aa3 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.215229 Oct 27 13:25:37.991464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 113/228] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:37 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:38.089348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:38.097228 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5122e7ef-7530-47e1-b7a2-278037774b71 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.241728 Oct 27 13:25:38.097799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 116/229] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:37 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:38.231562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:38.232693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:38.239390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:38.239779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:38.240279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:38.240922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:38.241372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:38.241789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:38.311008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:38.324272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-148b72a0-727f-48ad-9f95-1e89b11953f6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1219 microversion: 2.1 time: 0.096408 Oct 27 13:25:38.324989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 114/230] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:38 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:39.020498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:39.021375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:39.029157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.029645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.030077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.030773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.031234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.031649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.121194 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:39.121811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:39.130372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.136496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.136967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.137846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.138388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.138818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.188422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:39.198365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-57f3adaf-c739-4dc9-be17-6c516ea7f328 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.186659 Oct 27 13:25:39.198948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 117/231] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:39 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:39.276121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:39.293214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b041eb6d-d889-4754-80b1-d83b424a3013 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.176263 Oct 27 13:25:39.294062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 115/232] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:39 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:39.347309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:39.348248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:39.355260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.355750 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.356179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.356899 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:39.357516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:39.358085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:39.425653 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:39.434874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a45f855e-69d8-4ac8-a050-869a644791da tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1267 microversion: 2.1 time: 0.091526 Oct 27 13:25:39.435663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 118/233] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:39 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1267 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:40.221284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:40.221889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:40.228052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.228571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.229006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.229689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.230138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.230562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.316200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:40.317023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:40.327471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.328407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.329012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.329973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.330618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.331199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.491219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:40.499339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5d8cc469-f6ca-475b-abd0-46a4fa1bddf9 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1368 microversion: 2.1 time: 0.187347 Oct 27 13:25:40.499935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 119/234] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:40 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:40.521469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:40.527996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:40.541356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.542116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.542727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.543645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:40.544320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:40.545230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:40.631565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:40.645374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ea3e94ff-f05a-47fe-9506-6a5530f0e34c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1273 microversion: 2.1 time: 0.131480 Oct 27 13:25:40.645971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 120/235] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:40 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1273 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:40.732276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:40.741465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f2ce728e-31f0-4b3e-bfc7-01323b8715dc tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.523969 Oct 27 13:25:40.742612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 116/236] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:40 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:41.508199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:41.508794 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:41.515469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.516155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.516626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.517320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.518039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.518518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.526965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:41.527908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:41.538928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.542214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.542722 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.543495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.547142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.547754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.587180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-be0d8b05-6674-408d-aa1e-aab8b9ff6e3f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/ips" status: 200 len: 144 microversion: 2.1 time: 0.083815 Oct 27 13:25:41.587771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 121/237] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:25:41 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/ips => generated 144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:41.672017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:41.672990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:41.680792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.681591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.682156 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.683061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.683907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.684705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.803365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:41.814840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2b9e5f7e-de1c-468a-bc04-4bb423e1c015 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1558 microversion: 2.1 time: 0.291991 Oct 27 13:25:41.816165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 117/238] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:41 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1558 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:41.834579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:41.835239 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:41.845263 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.845844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.846277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.847170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.847959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.848166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.896626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:41.906393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6d75a34a-ff43-4315-b9c7-3a89cfc084cf tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.238271 Oct 27 13:25:41.907310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 122/239] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:41 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:41.912699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:41.913481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:41.920868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.922182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.922832 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:41.923674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:41.924205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:41.924730 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:42.017089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c9dd9c6d-c230-4adc-80c1-a3f8959ffa2f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108519 Oct 27 13:25:42.018512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 123/240] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:25:41 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:42.154347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:42.164396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7bd4c001-f5c1-4d1a-b978-102af58b9c05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.345206 Oct 27 13:25:42.165084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 118/241] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:41 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:42.549718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4ed6eadd-6996-4e9e-87f7-2962fcacbd5e", "tag": "630e2996-5dfe-4ee3-9dd5-83ea4aa48f01"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:42.560537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:42.561310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:42.561963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:42.576140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] Creating event network-changed:630e2996-5dfe-4ee3-9dd5-83ea4aa48f01 for instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e on hv-cinder-86243 Oct 27 13:25:42.584019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-7cb5da66-3041-4569-ae77-34e9ff8a39ac req-ddb24f73-8080-4898-b9ec-996b2cf383e7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038072 Oct 27 13:25:42.585258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 124/242] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:42.938223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:42.938934 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:42.954002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:42.963147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:42.968309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:42.969358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:42.973951 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:42.974924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:43.159785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7e8b8230-922c-4d41-90e1-6b62526afc91", "tag": "6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:43.185620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:43.186946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:43.187937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:43.204366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] Creating event network-changed:6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c for instance 7e8b8230-922c-4d41-90e1-6b62526afc91 on hv-cinder-86243 Oct 27 13:25:43.209424 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-ea05ccc3-3ecf-46a1-8317-b611783e7fe5 req-b124698d-01d7-40d9-9c71-d97eeecc40ce service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054232 Oct 27 13:25:43.213996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 125/243] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:25:43.219977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:43.220775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:43.227550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:43.228453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:43.229152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:43.230260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:43.230886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:43.231503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:43.441547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:43.456045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-44ba9ae4-0253-4f27-935d-8ace788cf8ab tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.524564 Oct 27 13:25:43.469495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 119/244] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:42 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:43.519593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:43.527428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d69af881-607b-4552-802f-df30893e5204 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.311811 Oct 27 13:25:43.528198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 126/245] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:43 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:44.483216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:44.483825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:44.490097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:44.490588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:44.491035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:44.491753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:44.492208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:44.492660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:44.551346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:44.552576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:44.560864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:44.560864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:44.561284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:44.561974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:44.562596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:44.563082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:44.693745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:44.703615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4e029268-57ed-4d81-b7b5-56e4cab3d3bb tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.224113 Oct 27 13:25:44.704512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 120/246] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:44 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:44.819007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:44.844288 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=12 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:45.045314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:45.055565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ab8c495f-634b-4f25-9ac3-8993b16892da tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.507876 Oct 27 13:25:45.056265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 127/247] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:44 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:45.726481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:45.727025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:45.728857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=8 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:45.734531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:45.735011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:45.735439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:45.736125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:45.736635 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:45.737052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:45.862048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:45.870127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-820806cb-dfdf-4f17-9d7c-3c749ecfc786 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.148153 Oct 27 13:25:45.870688 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 121/248] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:45 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:46.078918 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:46.079464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:46.086944 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:46.087426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:46.087868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:46.088575 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:46.089031 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:46.089456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:46.213706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:46.221230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-83f5896d-ffd6-4603-b48e-8652d94c7e99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.146256 Oct 27 13:25:46.221789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 128/249] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:46 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:46.893155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:46.893863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:46.900100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:46.900412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:46.900849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:46.901547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:46.902055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:46.902461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:47.063009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:47.075564 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5b893c8b-7a76-4f0e-b66e-fb23bb7dea8f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.186115 Oct 27 13:25:47.084310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 122/250] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:46 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:47.245680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:47.246367 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:47.255383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:47.259933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:47.260502 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:47.261649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:47.262171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:47.263224 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:47.399834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:47.407971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-129c742f-1953-4be6-893d-735047d2f582 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.167253 Oct 27 13:25:47.408504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 129/251] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:47 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:48.100221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:48.101398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.109809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.110302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.110738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.111444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.111915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.112378 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.279346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:48.309215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e752e095-21d6-4d38-82af-4963d6bb3242 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.212634 Oct 27 13:25:48.320261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 123/252] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:48 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:48.362478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c51fc858-0387-4318-a1e7-61f4239987f0"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:48.365209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.374398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.375025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.375571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.376345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.376938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.377461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.433680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:48.434317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.440641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.440991 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.441428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.442328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.442787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.443213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.586983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:48.594752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-362a5cfb-6c09-4b2c-9b9c-4011dfd55122 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1501 microversion: 2.1 time: 0.165579 Oct 27 13:25:48.595322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 124/253] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:48 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1501 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:48.617672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54a19d38-d0ee-4d24-a4ea-49feb2fe8256"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:48.620668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.626509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.627001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.627441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.628139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.628629 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.629056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.652648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] HTTP exception thrown: Cannot 'attach_volume' instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 while it is in vm_state rescued Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Request method failure captured: Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/os-volume_attachments HTTP/1.1 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 74 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1xAtUYrOex98HvjYZlXP0lCdqcKA9lU9x9gpDqxomiQllgjNl3CeHtaWElMpZyLhkIVdMNzfyGu3XpYubic1m1__Hlyxu7bbBlLyrigpCJI1GH_ZSqLd8fYGv4HrHQV_w1OhNa5mBqN3L2RrEvavlCQcpysTSqHq8jqovhh8dDCQ Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:25:48.654327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 97d696ea0031417d8a1a0b8471c26579 Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {"volumeAttachment": {"volumeId": "54a19d38-d0ee-4d24-a4ea-49feb2fe8256"}} Oct 27 13:25:48.655733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Cannot 'attach_volume' instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 while it is in vm_state rescued Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'server_id': '8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2', 'body': {'volumeAttachment': {'volumeId': '54a19d38-d0ee-4d24-a4ea-49feb2fe8256'}}} Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:25:48.656656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 while it is in vm_state rescued Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:25:48.658013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 while it is in vm_state rescued Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Returning 409 to user: Cannot 'attach_volume' instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 while it is in vm_state rescued {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2b5a1e20-f7d1-4067-a894-ea027daf08a4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042791 Oct 27 13:25:48.659237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 125/254] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:25:48 2022] POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 27 13:25:48.664758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:48.665282 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.670942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.671363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.671800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.672523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.672979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.673406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.742882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7ac03b58-9967-408a-aa7f-6a414a87a554 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/action" status: 202 len: 0 microversion: 2.1 time: 0.081846 Oct 27 13:25:48.747072 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 126/255] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:25:48 2022] POST /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:25:48.752803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:48.753928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:48.761791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.762841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.763681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.764625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:48.765187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:48.765766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:48.908277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:48.918501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4096ffda-5ff9-46f3-b64a-19bf7175f3e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.169898 Oct 27 13:25:48.919164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 127/256] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:48 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:48.931253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3d0c44ff-4755-4db7-afb5-98aa40e7c2d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.575496 Oct 27 13:25:48.932133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 130/257] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:25:48 2022] POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments => generated 194 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:25:49.333324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:49.335122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:49.341926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:49.342690 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:49.343223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:49.343977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:49.344705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:49.345204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:49.530912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:49.545160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-de6c9a51-47a4-47c9-8e2a-0fd79b4b4e7c tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.215810 Oct 27 13:25:49.546417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 128/258] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:49 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:49.643390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed6eadd-6996-4e9e-87f7-2962fcacbd5e", "name": "network-vif-plugged", "status": "completed", "tag": "630e2996-5dfe-4ee3-9dd5-83ea4aa48f01"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:49.655540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:49.656191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:49.657157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:49.670889 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] Creating event network-vif-plugged:630e2996-5dfe-4ee3-9dd5-83ea4aa48f01 for instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e on hv-cinder-86243 Oct 27 13:25:49.677522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-2462d5d9-e093-4c7d-af22-eb0f96831750 req-a309339f-40d7-4384-9044-26950af23c4f service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038713 Oct 27 13:25:49.678146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 131/259] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:25:49.941887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:49.942494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:49.949155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:49.949631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:49.950060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:49.950735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:49.951186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:49.951603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:49.969246 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:50.084738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:50.092218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-97fa6c14-9282-4559-9a93-72f837c30f96 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.154162 Oct 27 13:25:50.092792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 129/260] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:49 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:50.570839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:50.571564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:50.573481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=4 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:50.579605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:50.580081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:50.580543 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:50.581222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:50.581700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:50.582115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:50.712058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:50.719624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-58b243c1-0ce3-49c5-8365-3973e62e74e8 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.153970 Oct 27 13:25:50.720190 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 132/261] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:50 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:51.114744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:51.115366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:51.121250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:51.121731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:51.122163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:51.122846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:51.123296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:51.123715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:51.250197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:51.258291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-19a724b3-87af-4a49-85ec-cf34a90b49a8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.146828 Oct 27 13:25:51.259142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 130/262] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:51 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:51.743368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:51.743983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:51.750431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:51.750913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:51.751346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:51.752030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:51.752511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:51.752936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:51.883219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:51.891001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-04c09fcc-afff-4da5-a0fe-780543a69a80 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.152087 Oct 27 13:25:51.891566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 133/263] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:51 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:52.281395 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:52.282002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:52.283832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:52.289640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:52.290113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:52.290538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:52.291218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:52.291665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:52.292084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:52.423299 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:52.431022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a2ea1d87-fb6f-4d08-9075-137d8daf8715 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.153494 Oct 27 13:25:52.431574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 131/264] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:52 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:52.914461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:52.915077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:52.921603 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:52.922081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:52.922511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:52.923191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:52.923642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:52.924063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:52.941466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:25:53.053222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:53.060703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e3960a6a-5ea2-452e-bd41-506872357173 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.150597 Oct 27 13:25:53.061271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 134/265] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:52 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:53.442889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:53.443428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:53.449349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:53.449775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:53.450206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:53.450894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:53.451345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:53.451769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:53.454639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:53.455255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:53.461089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:53.461572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:53.462003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:53.462687 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:53.463138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:53.463560 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:53.475674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8c0c8186-b902-4b9d-b09b-f69c43bc50dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/ips" status: 200 len: 151 microversion: 2.20 time: 0.036597 Oct 27 13:25:53.476780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 132/266] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Oct 27 13:25:53 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:25:53.595488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:53.604549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dfb4df1e-9da1-4a01-841a-cb5ccf9ae094 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.153713 Oct 27 13:25:53.605292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 135/267] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:53 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:54.083090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:54.083634 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:54.090132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:54.090617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:54.091055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:54.091746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:54.092202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:54.092655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:54.217842 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:54.225371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fa911f54-3b9f-4261-8cd7-0665607695fd tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.146255 Oct 27 13:25:54.225938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 133/268] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:54 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:54.627355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:54.627974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:54.635092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:54.635571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:54.636007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:54.636729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:54.637182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:54.637609 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:54.764463 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:54.771962 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-61e8e03b-5c60-4327-842b-15af73f47051 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.148447 Oct 27 13:25:54.772561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 136/269] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:54 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:55.248496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:55.249108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:55.254933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:55.255406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:55.255835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:55.256544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:55.256993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:55.257981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:55.387565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:55.395064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a39cc8f4-f346-48fc-8d72-4d7dda9378d6 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.150410 Oct 27 13:25:55.395627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 134/270] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:55 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:55.795522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:55.796122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:55.802477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:55.802953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:55.803380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:55.804877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:55.805335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:55.805755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:55.949413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:55.957033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-201c275c-a2a9-4678-bea3-7e8187e99511 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.165311 Oct 27 13:25:55.957604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 137/271] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:55 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:56.417360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:56.417971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:56.423869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:56.424391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:56.424826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:56.425513 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:56.425965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:56.426387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:56.561408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:56.569201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-16dbb226-d440-4843-ac66-fcbbdb25c466 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.155702 Oct 27 13:25:56.570731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 135/272] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:56 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:56.981876 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:56.982495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:56.989074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:56.989559 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:56.989999 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:56.990703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:56.991161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:56.992258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:57.194222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:57.202586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c781047c-3f3e-4bb2-bf47-0451b6f22d2c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1509 microversion: 2.1 time: 0.224594 Oct 27 13:25:57.203249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 138/273] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:56 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1509 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:57.593175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:57.593779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:57.599692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:57.600167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:57.600633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:57.601952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:57.602385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:57.602804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:57.728031 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:57.735694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-db6c2141-5f09-4f5f-850e-2772cec4baaa tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.146309 Oct 27 13:25:57.736273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 136/274] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:57 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:58.102977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:25:58.103510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:58.111228 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.111707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.112145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.112862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.113315 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.113740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.135935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lazy-loading 'flavor' on Instance uuid 896767c6-1a1e-4729-992a-7d4dfa6b503c {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:25:58.226719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:58.227371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:58.233683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.234165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.234603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.235301 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.235755 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.236178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.349007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dd671e22-6424-4f5a-8e41-ad3764f19c87 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/action" status: 202 len: 0 microversion: 2.20 time: 0.250135 Oct 27 13:25:58.349975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 139/275] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Oct 27 13:25:58 2022] POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:25:58.359241 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:58.359933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:58.366085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.366888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.367321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.368018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.369598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.370416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.376028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:58.384813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6aeedc93-53ca-4134-b0eb-71f027d2ede4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1515 microversion: 2.1 time: 0.162650 Oct 27 13:25:58.385495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 137/276] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:58 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:25:58.504439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:58.514303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:58.516015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:58.517490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-36f5ac5b-c438-4983-b683-98c4e57075a0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.162218 Oct 27 13:25:58.531490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 140/277] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:25:58 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:25:58.759171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:58.759807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:58.765712 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.766187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.766613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.767325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:58.767771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:58.768187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:58.894154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:58.901673 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-786861df-6184-4992-a28a-db1acd819e51 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.147432 Oct 27 13:25:58.902235 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 138/278] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:58 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:25:59.548109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:59.548752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:59.556034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:59.556515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:59.557017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:59.557712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:59.558166 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:59.558594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:59.687697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:59.696977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:59.698491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:25:59.699663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3faf6d1d-7cc3-4456-99dd-9f18fd7bccdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.155406 Oct 27 13:25:59.700261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 141/279] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:25:59 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:25:59.924282 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:25:59.924915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:25:59.931316 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:59.931793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:59.932245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:25:59.932936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:25:59.933382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:25:59.933800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.061027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:00.068530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e3d3d6d6-4ec5-437d-a26c-c7707cfdd7db tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.148032 Oct 27 13:26:00.069208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 139/280] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:25:59 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:00.712709 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:00.719904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:00.720045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:00.720494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.724735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:00.725343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:00.731278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:00.731759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:00.732193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.732943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:00.733402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:00.733827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.786801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Going to try to stop instance {{(pid=118774) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 13:26:00.833522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2d4f283a-4b7e-4045-9a63-f885595c29b5 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.124709 Oct 27 13:26:00.834280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 142/281] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:26:00 2022] POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:26:00.844177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:00.844976 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:00.851959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:00.852529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:00.853000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.853712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:00.854169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:00.854611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:00.876113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:00.885149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:00.886769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:00.888040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-68eb3886-3404-4f1f-82a8-2fe8e0d9ce9f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.167059 Oct 27 13:26:00.888625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 140/282] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:00 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:00.995186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:01.003335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2e027027-778e-4c5c-b655-d6ac1cd85be6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.163976 Oct 27 13:26:01.003902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 143/283] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:00 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:01.090388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:01.090999 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:01.097032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:01.097459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:01.097898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:01.098583 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:01.099040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:01.099462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:01.223723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:01.231264 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-214f2ee5-a033-47a4-8607-acb1cd1d056f tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.144666 Oct 27 13:26:01.231823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 141/284] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:01 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:01.876569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-08805d27-4b7f-4392-b71b-515fb5c892df tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: .version_select at 0x7fb3735fc280>, body: {"keypair": {"name": "tempest-keypair-29583311", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGw4IOI94uVhL1KTyzRJvCbQNbDDj9m0065C8dB9FVPfoUggr5lsiipXcqkouv0JuVIdAs1yLbZo2VSfGedYxZryrqJI+ElYsePVTqV8w+PowkrkGYiAtPvgIadovWohZQ=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:01.892816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-08805d27-4b7f-4392-b71b-515fb5c892df tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:26:01.896552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-08805d27-4b7f-4392-b71b-515fb5c892df tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for user 97d696ea0031417d8a1a0b8471c26579 and project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:26:01.915283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:01.916068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:01.918554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-08805d27-4b7f-4392-b71b-515fb5c892df tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.045811 Oct 27 13:26:01.919170 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 144/285] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:26:01 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:01.922710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:01.923203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:01.923645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:01.924370 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:01.924831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:01.925269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:02.027850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:02.028509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:02.034552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:02.035038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:02.035471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:02.036165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:02.036647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:02.037089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:02.121367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:02.134090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:02.135876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:02.138102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1b1153c8-753f-446d-abcc-fa151e7c55d5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.227214 Oct 27 13:26:02.138984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 142/286] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:01 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:02.226357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:02.236043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ed0f0fbc-ee5b-4fe2-83cc-5edab8d3db16 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.212233 Oct 27 13:26:02.236649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 145/287] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:02 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:02.264675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:02.265346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:02.271476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:02.271969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:02.272983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:02.273689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:02.274135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:02.274558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:02.442326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:02.450893 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c2d77008-3c87-428a-a680-c6a69c2216ec tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.190286 Oct 27 13:26:02.451701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 143/288] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:02 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:03.170710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:03.171270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:03.178211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.179551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.180003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.180726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.181174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.181590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.266850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:03.267465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:03.274068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.274613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.275043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.275958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.276459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.276887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.349715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:03.359892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:03.361369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:03.362915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c17e9600-b15a-4d0a-8612-d5868627b116 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.196762 Oct 27 13:26:03.363641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 146/289] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:03 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:03.412110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-359480900", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7787e3c-cdc7-4d31-9969-b3505bdbc01b"}], "security_groups": [{"name": "tempest-securitygroup--1894743749"}], "key_name": "tempest-keypair-29583311", "user_data": "}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:03.431122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:03.439460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c7568fdb-fe3b-4969-8064-cd879e8dfb55 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.176546 Oct 27 13:26:03.440027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 144/290] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:03 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:03.474111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:03.474810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:03.481665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.482230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.482745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.483533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.484060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.484587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.527068 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] validate_networks() for [('d7787e3c-cdc7-4d31-9969-b3505bdbc01b', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:26:03.621966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:03.629532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-78388e71-f558-4f7f-b76b-c0a48cd75839 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.159303 Oct 27 13:26:03.630092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 145/291] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:03 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:03.906167 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:26:03.906596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:26:03.907095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:26:03.907503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:26:03.907912 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:26:03.916677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.917153 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.917587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.918324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:03.918764 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:03.919189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:03.935270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:26:03.939185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Getting quotas for user 97d696ea0031417d8a1a0b8471c26579 and project a58f7c57ef7f4a54999d16d765d80cc2. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:26:03.950471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:26:03.952752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:26:04.000961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c36f6cda-d0b0-4df1-ad9f-e7f2d5a88807 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.593361 Oct 27 13:26:04.001602 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 147/292] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:26:03 2022] POST /compute/v2.1/servers => generated 409 bytes in 595 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:26:04.013608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8f3cf581-cc1f-4e9c-bb7e-a5ce952e2559 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:04.014228 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8f3cf581-cc1f-4e9c-bb7e-a5ce952e2559 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:04.067233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8f3cf581-cc1f-4e9c-bb7e-a5ce952e2559 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.076302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8f3cf581-cc1f-4e9c-bb7e-a5ce952e2559 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1243 microversion: 2.1 time: 0.066477 Oct 27 13:26:04.076872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 146/293] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:04 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1243 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:04.389969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:04.390582 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:04.397861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.398344 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.398775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.399453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.399901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.400346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.462823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:04.463439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:04.469852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.470345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.470789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.471490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.471949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.472406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.491626 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:04.531217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.540978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.542507 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.543800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5d7c5fd5-83f9-4abb-9f06-9ae71421c069 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.157749 Oct 27 13:26:04.544713 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 148/294] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:04 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:04.604822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.613561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e01425ed-a7f1-4c00-8448-d4af49b02f2d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.154707 Oct 27 13:26:04.614219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 147/295] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:04 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:04.653172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:04.653782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:04.659649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.660133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.660600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.661283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:04.661726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:04.662141 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:04.792210 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:04.795793 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:04.800841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c9cac054-627d-4c02-829d-bcb4a81e47fc tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1315 microversion: 2.1 time: 0.151702 Oct 27 13:26:04.801444 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 149/296] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:04 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:05.098355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:05.098971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:05.105854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.106341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.106782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.107483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.107942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.108412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.172438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:05.180578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6ef4bd8b-04ac-4803-a19e-361fbaae8c98 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1247 microversion: 2.1 time: 0.086124 Oct 27 13:26:05.181433 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 148/297] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:05 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1247 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:05.569858 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:05.570512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:05.578101 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.578588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.579067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.579718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.580178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.580650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.637010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:05.637628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:05.649320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.650475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.650918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.651627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.652716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.653184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.778048 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:05.790621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:05.793669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:05.804406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-be982b56-30f5-4179-9376-85807ae68d68 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.229985 Oct 27 13:26:05.804515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:05.813556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 150/298] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:05 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:05.823402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1cd24de7-e454-4cf9-90f4-c7c0b21d9d4b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.188759 Oct 27 13:26:05.824071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 149/299] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:05 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:05.824674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:05.825501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:05.840968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.844676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.846287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.846287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:05.846471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:05.847402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:05.993874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:06.002427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4b81a81e-d2c8-4cc8-a76a-25a5612fce2e tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1465 microversion: 2.1 time: 0.183324 Oct 27 13:26:06.003293 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 151/300] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:05 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1465 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:06.066568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:06.067197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:06.075023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.076762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.077327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.078034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.078488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.078977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.109092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:26:06.199952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-23da89f3-a457-44b8-aa1a-9ff786508669 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "DELETE /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 204 len: 0 microversion: 2.1 time: 0.136783 Oct 27 13:26:06.200778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 150/301] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:26:06 2022] DELETE /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:26:06.208567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:06.209642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:06.211044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:06.211952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:06.218872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.219704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.220383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.220702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.221300 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.221822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.221942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.222739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.222875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.223428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.223902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.224178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.301542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:06.310124 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-600fb0db-8cef-467a-bda8-761afc1fe2ba tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1295 microversion: 2.1 time: 0.110718 Oct 27 13:26:06.310596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 152/302] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:06 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1295 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:06.377175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:06.390005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3d1ddbda-97f1-4d5d-a14c-00abc1036860 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1471 microversion: 2.1 time: 0.184405 Oct 27 13:26:06.390661 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 151/303] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:06 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1471 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:06.825038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:06.825647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:06.832217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.832738 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.833170 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.833870 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.834319 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.834742 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.848949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:06.849564 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:06.856199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.856730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.857171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:06.857879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:06.858332 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:06.858761 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:07.004671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.015355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.016942 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.017518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.018297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9d2bd19c-f1b3-4bc9-b16d-201a9bd3a5ab tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.197206 Oct 27 13:26:07.018871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 153/304] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:06 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:07.026647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8abff8ed-e000-482f-81fa-8b4435671fec tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.181504 Oct 27 13:26:07.027234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 152/305] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:06 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:07.333021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:07.333668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:07.341159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:07.342069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:07.342887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:07.344174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:07.345060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:07.345865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:07.413826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:07.414590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:07.420781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:07.421438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:07.422227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:07.422679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.423010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:07.423503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:07.424090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:07.431516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4cc527fb-939f-4ebc-a2fa-ad9a9de84a67 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1295 microversion: 2.1 time: 0.102288 Oct 27 13:26:07.444754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 154/306] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:07 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1295 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:07.579877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:07.587454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-44580dbc-579b-4619-ba6c-0cd8651f1285 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1471 microversion: 2.1 time: 0.178289 Oct 27 13:26:07.588050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 153/307] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:07 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1471 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:08.045763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:08.046557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:08.051535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:08.053204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:08.053379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.054071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.054724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.055556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.056121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.056674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.060901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.061915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.062355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.063058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.063672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.064271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.203510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:08.212805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:08.214542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:08.215947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-02279f3d-fd26-4436-b42d-bed528999af1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.174113 Oct 27 13:26:08.220847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:08.224159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 155/308] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:08 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:08.233233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cfa37efd-42f0-4048-aca4-d7efee679bc9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.186731 Oct 27 13:26:08.233980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 154/309] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:08 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:08.458056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:08.458995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:08.465975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.466817 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.467505 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.468737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.469491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.470276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.618741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:08.619615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:08.631027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.643070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:08.646222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.650915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:08.653484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-26b1d6da-b971-47ed-a9b8-9b97489f79d7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1303 microversion: 2.1 time: 0.199851 Oct 27 13:26:08.655457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:08.657251 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:08.657657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 156/310] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:08 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1303 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:08.662096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.216683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.230430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ddcd8ffa-73c0-4ba4-a0d3-9d22434a33f9 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1471 microversion: 2.1 time: 0.619950 Oct 27 13:26:09.231386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 155/311] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:08 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1471 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:09.253047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:09.254339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:09.257509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:09.259264 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:09.264280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.265002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.265524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.266393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.267048 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.267595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.269298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.269995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.270627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.271474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.272168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.272917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.561983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.569390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.574601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4750ccd6-4bf0-45e9-ace3-6728131cfe23 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.321231 Oct 27 13:26:09.586330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.588884 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.589435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 156/312] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:09 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:09.596982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4cd67e3d-2e58-48fe-bb91-77ff40c96bd3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.349694 Oct 27 13:26:09.600311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4ed6eadd-6996-4e9e-87f7-2962fcacbd5e", "name": "network-vif-deleted", "tag": "630e2996-5dfe-4ee3-9dd5-83ea4aa48f01"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:09.601784 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 157/313] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:09 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:09.610961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.611744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.612457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.627397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] Creating event network-vif-deleted:630e2996-5dfe-4ee3-9dd5-83ea4aa48f01 for instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e on hv-cinder-86243 Oct 27 13:26:09.633913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-c7106ce0-669a-466e-8e87-821113ee074e req-b4aa4193-3e45-4422-b69b-ac11a5a36ad2 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042828 Oct 27 13:26:09.634849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 157/314] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:09.687829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:09.688657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:09.695089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.695744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.696186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.696957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:09.697572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:09.698006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:09.938429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:09.947265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-20a40517-ab22-48fb-9938-a96c0f4d87aa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1301 microversion: 2.1 time: 0.264060 Oct 27 13:26:09.948002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 158/315] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:09 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1301 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:10.262343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:10.263067 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:10.273613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.274435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.274959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.275717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.276447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.277247 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.333110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.334118 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.335301 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.336266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lazy-loading 'fault' on Instance uuid 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:26:10.399768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e89e34bc3817448d93d576348bd346de', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ad0ac3d8983248bcad9b84c1be67bc47', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:10.411496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1bbe9662-d4e0-4441-bdac-05651a26d8ac tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 200 len: 1305 microversion: 2.1 time: 0.156027 Oct 27 13:26:10.412415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 158/316] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:10 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 1305 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:10.602961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:10.603585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:10.610412 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.611023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.611466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.612174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.612829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.613265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.635766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:10.636413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:10.643014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.643501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.646010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.646743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.647756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.648186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.827691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:10.850390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:10.851475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:10.852770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8b4b5251-3574-4e38-a740-838ade3c0e46 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.221747 Oct 27 13:26:10.873707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:10.891326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 159/317] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:10 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:10.894862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9e95423f-c6f0-4a33-ae18-07ba16b13d6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.295732 Oct 27 13:26:10.895441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 159/318] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:10 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:10.971809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:10.972741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:10.978903 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.979391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.979828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:10.980557 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:10.981043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:10.981471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.145749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:11.154245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b89e60dd-6984-4b2b-94ac-7485ce4eb0fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.186549 Oct 27 13:26:11.168774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 160/319] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:10 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:11.435329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:11.436417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] [instance: 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:11.442730 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.443216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.443685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.444423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.444873 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.445454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.459946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] HTTP exception thrown: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Request method failure captured: Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e HTTP/1.1 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWobMZOJxgwQAbfFuO0dcUii55AhU0tFO_B1BpZ5jTHXZhd1qrEReLTJ0FQSbqB3mb2tGM8b7yZSknfXao1XUJhA5nEBPtB81krmUW-6YZIB0BhuaMttwQO5xbs2Bd03FJd-GUcNCVIWR5Y54WjqtYhiJzwjfxPDlYJOLrmVREKS8C58 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: ad0ac3d8983248bcad9b84c1be67bc47 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-VolumesNegativeTest-836003548 Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:26:11.461690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/ad0ac3d8983248bcad9b84c1be67bc47"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad0ac3d8983248bcad9b84c1be67bc47"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/ad0ac3d8983248bcad9b84c1be67bc47"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_ad0ac3d8983248bcad9b84c1be67bc47"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-VolumesNegativeTest-836003548 Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: ad0ac3d8983248bcad9b84c1be67bc47 Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-VolumesNegativeTest-836003548 Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-VolumesNegativeTest-836003548-project Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: e89e34bc3817448d93d576348bd346de Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-VolumesNegativeTest-836003548-project Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. Oct 27 13:26:11.463136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '4ed6eadd-6996-4e9e-87f7-2962fcacbd5e'} Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:26:11.464015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. Oct 27 13:26:11.465429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:26:11.466506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] Returning 404 to user: Instance 4ed6eadd-6996-4e9e-87f7-2962fcacbd5e could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:26:11.466506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3b18968f-5171-4d50-85e0-a6766d29bd69 tempest-VolumesNegativeTest-836003548 tempest-VolumesNegativeTest-836003548-project] 10.222.0.48 "GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e" status: 404 len: 111 microversion: 2.1 time: 0.031750 Oct 27 13:26:11.466506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 160/320] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:11 2022] GET /compute/v2.1/servers/4ed6eadd-6996-4e9e-87f7-2962fcacbd5e => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:26:11.895259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:11.897640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:11.900887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:11.906106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.906838 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.908319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.909691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.910259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.910812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.919789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.920302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.920922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.933007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] Creating event network-changed:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:26:11.939151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-7c09a959-1db8-4266-9f00-fd6da13703ac req-bada3839-7566-4924-b686-2d71ee4622a9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045749 Oct 27 13:26:11.939859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 161/321] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:11.946003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:11.946877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:11.955964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.956590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.957185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:11.958079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:11.958936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:11.960103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:12.109340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:12.119575 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:12.121787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:12.123346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bb51e29e-ccbd-4985-922c-2eb52cc4987d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.233454 Oct 27 13:26:12.131902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 161/322] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:11 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:12.179215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:12.180395 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:12.188579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:12.189081 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:12.189514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:12.196927 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:12.200368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:12.200809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:12.245218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:12.261109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c65b3751-5fd9-4135-81e3-1bb41acb0f6b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.320027 Oct 27 13:26:12.264362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 162/323] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:11 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:12.356334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:12.360206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:12.366644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-695e3dfd-fb2d-4e95-ae12-e196d1a72c70 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.191801 Oct 27 13:26:12.367207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 162/324] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:12 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:13.152302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:13.153007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:13.159504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.159989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.160517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.161301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.161756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.162174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.286851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:13.287608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:13.295740 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.296824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.297591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.299087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.300632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.301272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.377537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:13.387007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:13.388472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:13.396088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e024076f-2b60-4c74-9173-b0e9aaf356ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.241322 Oct 27 13:26:13.396799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 163/325] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:13 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:13.421170 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:13.421796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:13.437015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.437506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.437946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.438649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:13.439097 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:13.439534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:13.484965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:13.498767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-29424f64-0409-4715-a807-65ce8f8dd690 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.218094 Oct 27 13:26:13.499984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 163/326] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:13 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:13.594422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:13.602665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f19389a0-fff8-4875-a3c8-15f078bdfb15 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.188433 Oct 27 13:26:13.603655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 164/327] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:13 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:14.430379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:14.431431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:14.434848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:14.439946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.440634 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.441186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.442036 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.444857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.445325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.527293 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:14.529301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:14.536559 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:14.538639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=10 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:14.548454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.549758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.550703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.552085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.553634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.554574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.693528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:14.704276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:14.706550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:14.708116 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-41e51df6-edfc-47de-a559-79e92b5f3fd9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.284779 Oct 27 13:26:14.708899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 164/328] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:14 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:14.717440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:14.718282 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:14.734252 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.735079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.735536 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.736311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:14.736775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:14.737203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:14.794704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:14.810228 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-472ea7c4-cf4b-4c17-b399-f21cc71b384b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.289724 Oct 27 13:26:14.819824 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 165/329] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:14 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:14.996954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:15.019067 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5715dcd9-3c2d-4e7f-ad43-6ee225bdcf0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.308213 Oct 27 13:26:15.023950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 165/330] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:14 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:15.742694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:15.743305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:15.749698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:15.750177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:15.750614 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:15.751305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:15.751756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:15.752184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:15.846957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:15.847519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:15.854088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:15.854579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:15.855025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:15.855725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:15.856180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:15.856643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:15.879728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:15.887959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:15.889527 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:15.890684 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3fccf8fa-7dcf-4eea-b92e-55febb3a5f85 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.152528 Oct 27 13:26:15.891239 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 166/331] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:15 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:15.991764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:15.999902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4da7a677-334c-4ce2-a2b9-5d2a9a841051 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.156859 Oct 27 13:26:16.000492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 166/332] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:15 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:16.046988 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:16.047759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:16.053759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:16.054245 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:16.054685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:16.055385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:16.055846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:16.056308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:16.207508 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:16.212595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:16.217655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4bf1e999-d3f9-4cd2-b535-75d304c383bd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.174567 Oct 27 13:26:16.218421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 167/333] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:16 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:16.926529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "name": "network-vif-plugged", "status": "completed", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:16.928808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:16.929467 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:16.943604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:16.947180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:16.947900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:16.948766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:16.949306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:16.949814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:16.951216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:16.954632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:16.955241 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:16.971110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] Creating event network-vif-plugged:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:26:16.980423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-c5df3026-d966-4bd5-8aaf-d1fa5fe42aa4 req-31c25a15-eaba-4dc4-a1a2-a36664471aa0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058728 Oct 27 13:26:16.981655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 168/334] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:17.026192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:17.026906 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:17.029051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:17.035843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:17.036363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:17.036807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:17.038118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:17.038610 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:17.039077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:17.155435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:17.165733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:17.167620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:17.169249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7730aae6-9e93-4d9b-8dc8-45b57807c330 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1744 microversion: 2.20 time: 0.255704 Oct 27 13:26:17.170458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 167/335] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:16 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1744 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:17.233357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:17.242334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:17.242952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:17.244181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c3cab861-3a76-4a5e-bf23-900dbdbec9b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.224461 Oct 27 13:26:17.245177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 169/336] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:17 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:17.249424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:17.250704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:17.251233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:17.252473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:17.253010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:17.253525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:17.395760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:17.404298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5389c54f-5590-428c-84ea-0287e1d7694e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.166562 Oct 27 13:26:17.404881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 168/337] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:17 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:18.197517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:18.198139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:18.204862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.205357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.205861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.206573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.207163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.207850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.268257 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:18.268784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:18.275246 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.275715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.276148 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.277037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.277497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.277917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.425883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:18.427819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:18.445327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1d781a9e-6b26-4b08-8930-79661950eedc tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.181168 Oct 27 13:26:18.446724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:18.447909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 169/338] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:18 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:18.449329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:18.450583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5b28cbbe-e3ad-400e-b490-e0f9bd006409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1744 microversion: 2.20 time: 0.257692 Oct 27 13:26:18.451418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 170/339] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:18 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1744 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:18.454536 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:18.455429 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:18.462285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.463026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.463681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.464641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:18.465350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:18.465994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:18.633351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:18.644106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e221e436-0cde-4b7c-8413-a4327f4b443a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.194829 Oct 27 13:26:18.645419 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 170/340] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:18 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:19.471632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:19.473017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:19.477209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:19.478393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:19.480666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.481674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.482266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.483174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.483635 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.484221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.492923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.493908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.498338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.499515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.500154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.500795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.707352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:19.718261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:19.719832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:19.721325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-58a667c3-778b-47af-b5c3-793d2c04eca7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1744 microversion: 2.20 time: 0.248747 Oct 27 13:26:19.722094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 171/341] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:19 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1744 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:19.727737 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:19.728534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:19.735107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.735959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.736717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.737698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:19.738389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:19.739172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:19.983426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:19.997882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-20a2624d-591e-4806-8186-8ca3bc1784dd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.274291 Oct 27 13:26:19.998885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 172/342] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:19 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:20.049118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:20.059203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9dfa940b-0bb8-452a-a61f-3e9bbc936fcb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.591954 Oct 27 13:26:20.059966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 171/343] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:19 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:20.750184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:20.751464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:20.763302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:20.777510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:20.778371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:20.785742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:20.786526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:20.788780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.025203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:21.026540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:21.035526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:21.037283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:21.037925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.038914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:21.039557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:21.040417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.096324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:21.112663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:21.114290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:21.117193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-08205165-ffb1-4bae-9fc5-6fca500fc120 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.372833 Oct 27 13:26:21.118582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 173/344] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:20 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:21.134168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:21.137429 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:21.143667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:21.144685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:21.145273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.146283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:21.147389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:21.147968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.325437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:21.335807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6baa72ab-7c74-4dd5-a8dc-3dd7678052fa tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1369 microversion: 2.1 time: 0.316537 Oct 27 13:26:21.337348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 172/345] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:21 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1369 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:21.417341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:21.423957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "name": "network-vif-plugged", "status": "completed", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:21.434515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-aeb821c7-6c23-40f5-9129-048bf774c38a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1721 microversion: 2.1 time: 0.313708 Oct 27 13:26:21.435592 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 174/346] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:21 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:21.453556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:21.454269 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:21.454994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:21.479035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] Creating event network-vif-plugged:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:26:21.486646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-92fe03fc-13ff-41b0-90fb-42f02d128e1f req-d169b0b9-dff8-48ac-a547-d87129b7b1fa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066008 Oct 27 13:26:21.488874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 173/347] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:22.146276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:22.147973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:22.165812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.170162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.170894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.172158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.172796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.174384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.364012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:22.365280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:22.391647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.395268 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.396946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.399256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.401519 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.401998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.510774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:22.521936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:22.523763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:22.525457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-91d2e0ed-683c-4871-99ed-07293380d8e9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.384897 Oct 27 13:26:22.526529 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 175/348] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:22 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:22.531601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:22.532431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:22.538195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:22.540116 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.541135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.541736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.542599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.543308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.543879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.674516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:22.683050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f8995452-f62f-4021-9c54-b31b87f30b3f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1562 microversion: 2.1 time: 0.326459 Oct 27 13:26:22.683634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 174/349] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:22 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1562 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:22.706470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:22.706960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:22.727105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.727880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.729484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.731553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.734718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.735337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.843417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:22.853713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2358959e-2ec2-4c07-a571-eeb628b31bf0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1698 microversion: 2.1 time: 0.325928 Oct 27 13:26:22.865607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 176/350] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:22 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1698 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:22.892425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:22.905239 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:22.906028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:22.907342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:22.950952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3edf8ccd-bc8f-4320-b04b-9fe67821d25b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.248250 Oct 27 13:26:22.951626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 175/351] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:26:22 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-interface => generated 284 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:23.117648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Going to try to start instance {{(pid=118773) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 13:26:23.232387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ae304f95-00e3-4d99-b7e1-80dc89fa7024 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.345559 Oct 27 13:26:23.238590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 177/352] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:26:22 2022] POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:26:23.247558 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:23.248863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:23.262192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:23.264156 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:23.265326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:23.267499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:23.269624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:23.282423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:23.566627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:23.567559 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:23.597344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:23.597844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:23.598290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:23.599915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:23.604820 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:23.605666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:23.659725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:24.074878 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:24.092119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5ca09d08-2732-47ca-9faa-5a530ade1a70 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1707 microversion: 2.1 time: 0.849217 Oct 27 13:26:24.092990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 176/353] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:23 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1707 bytes in 851 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:24.331348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:24.348379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:24.351993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:24.353736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b9040e51-fe9e-4a9c-a3c8-c023729319d9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.803843 Oct 27 13:26:24.355804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 178/354] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:23 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:25.119849 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:25.121289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:25.134065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:25.134851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:25.135452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:25.141091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:25.141819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:25.142443 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:25.399789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:25.400484 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:25.410599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:25.412750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:25.413220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:25.418649 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:25.419219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:25.419677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:25.433866 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:25.448812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ad73e510-e7f0-446d-a512-928d2e0a9fc2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1707 microversion: 2.1 time: 0.329618 Oct 27 13:26:25.451883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 177/355] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:25 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1707 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:25.833654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:25.845039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:25.846646 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:25.848760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6a5ee914-e3f9-48d2-a716-56456c6258fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.454744 Oct 27 13:26:25.850197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 179/356] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:25 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:25.856033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:25.898008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:25.898545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:25.898914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:25.920968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] Creating event network-changed:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:26:25.940372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-9f9da39a-f617-41f0-9bf8-8c7bf807115d req-93613316-3b75-4d1f-9660-4166fe3fd8b1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088828 Oct 27 13:26:25.941850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 178/357] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:26.475849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:26.476603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:26.485710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:26.488324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:26.492482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:26.493550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:26.494188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:26.494926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:26.756432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:26.765945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-26641a57-15fb-4721-9b1f-1b5e185b8403 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1707 microversion: 2.1 time: 0.294458 Oct 27 13:26:26.766279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 180/358] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:26 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1707 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:26.880712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:26.882520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:26.894385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:26.896740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:26.900842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:26.901814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:26.902467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:26.904059 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:27.380157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:27.402354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:27.410600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:27.423592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6989dcb8-5463-4e37-a340-bba44594296a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.549220 Oct 27 13:26:27.424205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 179/359] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:26 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:27.798195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:27.798719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:27.809167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:27.819689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:27.820452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:27.825816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:27.826656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:27.827294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:28.188677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:28.201818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6c2c127c-2f2c-4bf5-bae8-6ee3a2727cd1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1711 microversion: 2.1 time: 0.408595 Oct 27 13:26:28.203156 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 181/360] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:27 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1711 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:28.458814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:28.459450 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:28.475469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:28.480952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:28.482231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:28.483482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:28.484198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:28.485436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:29.027506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:29.037183 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:29.044623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:29.053796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1e6ac6c8-4a31-48ab-833d-0b44f91647ad tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.599731 Oct 27 13:26:29.054487 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 180/361] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:28 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:30.092437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:30.093056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:30.114454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:30.115300 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:30.116142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:30.117084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:30.117729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:30.118368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:30.400838 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:30.423928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:30.425609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:30.428839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2866fda6-1e50-44a1-b24f-e2f794278e52 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.345360 Oct 27 13:26:30.463899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 182/362] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:30 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:31.461655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:31.462211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:31.469239 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:31.469996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:31.470589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:31.471607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:31.472064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:31.472525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:31.858869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:31.892125 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:31.894664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:31.897021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7002c544-327e-4681-a2d8-716e6fc4502c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.439960 Oct 27 13:26:31.942093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 181/363] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:31 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:32.964016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:32.965518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:32.972705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:32.979992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:32.981107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:32.982566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:32.983568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:32.984355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:33.166683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:33.179450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:33.184962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:33.186203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-00feb315-9f77-4556-afec-ccc9b32ed773 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.227180 Oct 27 13:26:33.186777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 183/364] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:32 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:34.220886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:34.221520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:34.229294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:34.230188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:34.230981 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:34.232911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:34.233572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:34.234193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:34.690474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:34.701109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:34.702705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:34.703953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6c8f17a2-f57f-4b53-ac58-8280633f161a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.494248 Oct 27 13:26:34.717129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 182/365] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:34 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:35.732952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:35.734302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:35.742028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:35.742990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:35.743643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:35.744672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:35.745420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:35.746090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:35.965138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:35.985834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:35.994055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:35.995705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fe7affd0-fb2a-4ac8-b797-0212585b54fd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.266948 Oct 27 13:26:36.008254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 184/366] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:35 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:37.028447 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:37.029723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:37.044028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:37.044577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:37.045027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:37.045748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:37.046209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:37.051880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:37.206113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:37.230182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:37.234645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:37.236880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d0294505-4daa-4c0f-8d73-098b5483f6b0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1739 microversion: 2.20 time: 0.214015 Oct 27 13:26:37.243410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 183/367] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:37 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1739 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:38.267709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:38.268636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:38.282490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:38.282994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:38.283433 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:38.286096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:38.287350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:38.287870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:38.512585 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:38.538872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:38.551105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:38.552461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fdfd05a6-92ca-49c1-957f-4857a60661cb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1721 microversion: 2.20 time: 0.288654 Oct 27 13:26:38.553019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 185/368] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:38 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:39.035947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:39.037047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:39.044289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:39.044783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:39.045212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:39.045912 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:39.046360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:39.046782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:39.071436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fdbb41ed-15a3-4bbb-a67e-4974914d2ec3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/ips" status: 200 len: 150 microversion: 2.1 time: 0.039405 Oct 27 13:26:39.072668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 184/369] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:26:39 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:39.582313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:39.584760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:39.597343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:39.598238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:39.599221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:39.599953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:39.600445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:39.600875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:39.777350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:39.787128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:39.788787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:39.790146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4f4191d6-c2c9-4728-a389-66a8d734907b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1721 microversion: 2.20 time: 0.215181 Oct 27 13:26:39.791308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 186/370] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:39 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:40.654604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f299ca0-b49f-41a4-aade-10eae68de70a"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:40.657160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:40.665857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:40.665857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:40.665857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:40.666494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:40.667026 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:40.667489 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:40.815802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:40.817108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:40.825648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:40.826129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:40.826558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:40.827257 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:40.828007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:40.828553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:41.066881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:41.083995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:41.085478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:41.087699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f797d547-5b46-47a9-9dd4-3c0e6157de84 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1721 microversion: 2.20 time: 0.275972 Oct 27 13:26:41.092664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 187/371] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:40 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1721 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:41.133209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:41.146907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0d1bada8-6452-4838-ada8-e7ab354acbb8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.496267 Oct 27 13:26:41.148024 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 185/372] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:26:40 2022] POST /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 194 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:41.153727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "name": "network-vif-unplugged", "status": "completed", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:41.173123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:41.175763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:41.177600 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:41.205312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] Creating event network-vif-unplugged:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:26:41.217974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-aacfc1aa-a81a-4e9b-9157-f6d8680d87c7 req-61e7118e-fb4a-4dc4-ab8a-05a23424e0aa service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.069587 Oct 27 13:26:41.219738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 188/373] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:26:42.118042 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:42.118978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:42.126389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.127189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.127826 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:42.128806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.129479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.129973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:42.288856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:42.301414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:42.304741 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:42.309737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-28107063-b208-4e61-868a-15d31240e6aa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1664 microversion: 2.20 time: 0.198342 Oct 27 13:26:42.312859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 186/374] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:42 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1664 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:42.352830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4197f6bc-482d-4f4c-8670-5ccb469cd09c"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:42.356169 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:42.362925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.363460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.364004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:42.364730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.365180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.365595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:42.767167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-43689c0c-1108-4519-84b6-2ab5927da3e8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.421039 Oct 27 13:26:42.768245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 189/375] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Oct 27 13:26:42 2022] POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments => generated 188 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:26:42.943517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:42.944468 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:42.951181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.951675 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.952120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:42.952931 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:42.953395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:42.953826 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:43.004117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118774) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 13:26:43.129270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0e7375f7-5ec9-4228-88af-69d2fb237b78 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/action" status: 202 len: 0 microversion: 2.20 time: 0.189837 Oct 27 13:26:43.136335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 187/376] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Oct 27 13:26:42 2022] POST /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/action => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:26:43.143101 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:43.143859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:43.151281 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:43.152027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:43.152656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:43.153363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:43.154021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:43.154597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:43.335269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:43.349077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:43.351969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:43.354769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-94dcfefa-7f8d-400b-8451-39ef59ab5868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1750 microversion: 2.20 time: 0.216238 Oct 27 13:26:43.356825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 190/377] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:43 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1750 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:44.391550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:44.392804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:44.399486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:44.400300 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:44.400836 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:44.401665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:44.402305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:44.402766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:44.594207 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:44.607527 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:44.609053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:44.610399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-020f674c-ad6c-41ac-ad3e-1103bfa3d57f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1750 microversion: 2.20 time: 0.223169 Oct 27 13:26:44.610951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 188/378] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:44 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:45.638814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:45.639409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:45.646179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:45.646663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:45.647099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:45.647798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:45.648271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:45.648691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:45.789233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:45.798687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:45.800201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:45.802181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7e032b3e-c743-44ec-bb30-0fda27193856 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1752 microversion: 2.20 time: 0.167299 Oct 27 13:26:45.803255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 191/379] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:45 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:46.831499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:46.832777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:46.840632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:46.841323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:46.842003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:46.842708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:46.843316 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:46.843734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:46.992541 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:47.002161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:47.009775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:47.011025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-39076fcf-0aa4-4755-b025-73835fb12a00 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1752 microversion: 2.20 time: 0.186443 Oct 27 13:26:47.011916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 189/380] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:46 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:47.744887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-edf0ebc7-4e70-414e-90b5-ed04afae8769 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'create', calling method: .version_select at 0x7fb373593ca0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-897010317", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCZny+uPwmBcleiVUDyby1cVwvcZRGdoClde+rVJs9gz+VRSp+9jc6bNC0s8SpJoUQ9vm7AKW9DDUSx4Gkz/CgB4oW1/JUsNELuLGRNug+iigzg/BN9yjvfMp/3JctKuXw=="}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:47.764493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-edf0ebc7-4e70-414e-90b5-ed04afae8769 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Getting quotas for project 52552d69672a4677bd52c847cceec247. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:26:47.768198 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-edf0ebc7-4e70-414e-90b5-ed04afae8769 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Getting quotas for user 706ba757aacf4256b1416b5e3bbda714 and project 52552d69672a4677bd52c847cceec247. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:26:47.807687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-edf0ebc7-4e70-414e-90b5-ed04afae8769 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066494 Oct 27 13:26:47.808427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 192/381] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:26:47 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:47.861256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-745624943", "imageRef": "b1357a8e-f4b6-4c93-82c8-45aada97c379", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-897010317", "networks": [{"uuid": "a9d120ae-00f9-4b43-8e0b-d259ad2386ec"}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:47.871016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:47.924663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] validate_networks() for [('a9d120ae-00f9-4b43-8e0b-d259ad2386ec', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:26:48.038196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:48.039063 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:48.045623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:48.046217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:48.046657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:48.047354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:48.047804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:48.048253 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:48.181200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:48.189802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:48.191793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:48.193208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-72068de8-3dd7-436f-87bf-a3ee2302b374 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1752 microversion: 2.20 time: 0.159059 Oct 27 13:26:48.193768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 193/382] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:48 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1752 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:48.319255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:26:48.319674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:26:48.320337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:26:48.320886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:26:48.321531 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:26:48.331421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:48.331949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:48.332577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:48.333309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:48.333755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:48.334362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:48.352710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Getting quotas for project 52552d69672a4677bd52c847cceec247. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:26:48.357500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Getting quotas for user 706ba757aacf4256b1416b5e3bbda714 and project 52552d69672a4677bd52c847cceec247. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:26:48.369894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:26:48.372253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='b1357a8e-f4b6-4c93-82c8-45aada97c379',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:26:48.422003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0c5f27da-f0ba-4b0d-acac-4407d09a0a3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.564710 Oct 27 13:26:48.423013 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 190/383] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:26:48.435499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ead2100-d6ac-4a3e-af59-e46549da5414 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:48.436126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7ead2100-d6ac-4a3e-af59-e46549da5414 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:48.508485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7ead2100-d6ac-4a3e-af59-e46549da5414 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:48.522266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7ead2100-d6ac-4a3e-af59-e46549da5414 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1257 microversion: 2.1 time: 0.091067 Oct 27 13:26:48.540386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 194/384] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:48 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1257 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:48.882179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-56378e28-16cc-4238-aafc-b1de3be9b458 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: .version_select at 0x7fb3736128b0>, body: {"keypair": {"name": "tempest-keypair-835323036", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEwJd0emCD1CmxuGLquKMFCuiAgMOcRDXEtuK7lodAVD0dZDsGqowsjvvParTlj3ZrxeXZubMwhyJH+wRhbvOhme3EnFjFaPW3sX4bEflDsV1hYd7TKYbHYDXXfPhGxLAg=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:48.907985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-56378e28-16cc-4238-aafc-b1de3be9b458 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:26:48.914343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-56378e28-16cc-4238-aafc-b1de3be9b458 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:26:48.942868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-56378e28-16cc-4238-aafc-b1de3be9b458 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.065331 Oct 27 13:26:48.943466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 191/385] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:26:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:49.219176 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:49.219795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:49.228494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:49.229356 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:49.229955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:49.230823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:49.231612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:49.232201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:49.237596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:49.428524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:49.440809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:49.442805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:49.444254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ad9d0415-4c86-42aa-a461-5dac269efb89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.229146 Oct 27 13:26:49.445041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 195/386] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:49 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:49.556519 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:49.557754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:49.567178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:49.567178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:49.567576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:49.568532 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:49.569179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:49.571235 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:49.711361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:49.725876 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-87d78de8-baed-44b4-badb-dd3a132b5a00 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1309 microversion: 2.1 time: 0.177209 Oct 27 13:26:49.727437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 192/387] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:49 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1309 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:50.476779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:50.477851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:50.489041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:50.490424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:50.491518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:50.493333 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:50.494456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:50.495504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:50.762175 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:50.762818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:50.770019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:50.770801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:50.771494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:50.772552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:50.773229 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:50.773851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:50.963784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:50.977061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:50.979234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:50.980867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9e87505c-123e-4a6d-9c6e-3d7132456807 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.511320 Oct 27 13:26:50.982222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 196/388] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:50 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:51.143571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:51.155762 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e5340e75-36fc-4d15-ae38-044542d27616 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1315 microversion: 2.1 time: 0.397577 Oct 27 13:26:51.158064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 193/389] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:50 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1315 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:52.008268 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:52.011665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:52.037230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:52.043624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:52.049091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:52.051327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:52.054062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:52.057310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:52.129157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-364121361", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4880e921-0c48-45fa-a974-af272c815db4"}], "security_groups": [{"name": "tempest-securitygroup--1139346870"}], "key_name": "tempest-keypair-835323036", "user_data": "}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:52.729007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:52.753597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:52.760621 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:52.762198 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1aa53ebe-a3f2-487e-b3d1-cb0d6cc01bdd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.758065 Oct 27 13:26:52.767209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 197/390] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:52 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:26:52.781323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:52.782011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:52.783982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:52.795761 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:52.802337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:52.802901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:52.803892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:52.804741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:52.805457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:53.347078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:53.357388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3c8f338e-5794-4e5b-b522-23979e79aac7 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.588937 Oct 27 13:26:53.364099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 198/391] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:52 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:26:53.793891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:53.794902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:53.822234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:53.824306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:53.826423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:53.830489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:53.833184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:53.834355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:54.142052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:54.166874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:54.168656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:54.170060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5fccbdbc-18fb-40ae-bdaa-6fc4f95655bd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.382986 Oct 27 13:26:54.170995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 199/392] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:26:53 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:26:54.175752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:54.196849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:54.197682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:54.198287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:54.211400 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] Creating event network-changed:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:26:54.218009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9deb15a1-a01b-404b-83a6-a35ff5623d8b req-58d6e99b-80e6-4b80-8139-0abc135d3c3a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045577 Oct 27 13:26:54.218682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 200/393] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:26:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:26:54.392394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:26:54.393492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:26:54.402757 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:54.403541 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:54.404186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:54.405283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:26:54.405915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:26:54.406493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:26:54.582387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:26:54.591045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fdc2a5df-541c-4f9b-b11a-ca09efe71194 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.205424 Oct 27 13:26:54.595259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 201/394] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:26:54 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:26:54.785473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-931988304", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "networks": [{"uuid": "e0bdb774-31d7-4659-a84f-c1ee72da57b4"}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:26:58.343020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:58.514046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=6 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:26:58.924355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=10 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:00.442868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] validate_networks() for [('e0bdb774-31d7-4659-a84f-c1ee72da57b4', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:27:00.489313 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] validate_networks() for [('4880e921-0c48-45fa-a974-af272c815db4', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:27:00.832222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:27:00.833462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:27:00.834194 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:27:00.835552 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:27:00.836211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:27:00.847759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.851456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.851972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.852815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.853699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.854143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.874188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Getting quotas for project 6ddba1e8bfeb4c8baf308e9b43bf1bee. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:27:00.879214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Getting quotas for user c12f89d30c834651b659ceeaa8a0fd54 and project 6ddba1e8bfeb4c8baf308e9b43bf1bee. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:27:00.893676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:27:00.896510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:27:00.903022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:27:00.903809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:27:00.904489 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:27:00.905201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:27:00.905898 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:27:00.923780 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.924689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.925391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.926538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.927400 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.928107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.949165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c1a5e879-3175-41fe-bb30-12ec27f574ff tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.170791 Oct 27 13:27:00.950063 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 202/395] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:26:54 2022] POST /compute/v2.1/servers => generated 380 bytes in 6172 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:27:00.954098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:27:00.954865 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:00.955619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:00.960843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:27:00.962769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.963265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.963756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.964507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:00.964967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:00.965395 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:00.975164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:27:00.977526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:27:01.044343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c8be289e-042d-43b4-a240-6193931cfa5c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 8.921707 Oct 27 13:27:01.051796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 194/396] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:26:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 8924 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:27:01.051796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:01.052518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:01.060155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:01.060948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:01.061488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:01.063137 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:01.063860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:01.064604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:01.304038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.334631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.336686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.338343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c270fe5e-7a81-42e4-b4f1-e9f7b4120aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.387424 Oct 27 13:27:01.339485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 203/397] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:00 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:01.345479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a748dff2-e11d-4bdd-ac7b-18a3ddc120f7 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:01.346213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a748dff2-e11d-4bdd-ac7b-18a3ddc120f7 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:01.351352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.374708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-711d370d-cb78-4e24-8396-3feb3cdaf09c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.327513 Oct 27 13:27:01.379103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 195/398] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:01 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:01.402791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-16d12f4d-d27b-4575-9f4a-5eb11686cd55 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:01.407696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-16d12f4d-d27b-4575-9f4a-5eb11686cd55 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:01.494947 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a748dff2-e11d-4bdd-ac7b-18a3ddc120f7 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.519028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a748dff2-e11d-4bdd-ac7b-18a3ddc120f7 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1218 microversion: 2.1 time: 0.178146 Oct 27 13:27:01.520088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 204/399] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:01 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1218 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:01.586280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-16d12f4d-d27b-4575-9f4a-5eb11686cd55 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:01.610167 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-16d12f4d-d27b-4575-9f4a-5eb11686cd55 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1240 microversion: 2.1 time: 0.229592 Oct 27 13:27:01.644927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 196/400] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:01 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1240 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:02.384418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:02.386125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:02.395032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.395882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.397672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.398691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.399382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.399970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.407461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:02.408255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:02.416593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.417099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.417773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.418736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.420028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.420028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.576512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.591650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.593454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.594870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e6f1d115-570c-447e-bff3-4e3f374c11df tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.216296 Oct 27 13:27:02.608798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 205/401] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:02 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:02.620515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:02.621654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:02.627786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.628607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.629414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.630379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.631015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.631732 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.642018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.664432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2878911c-d329-4073-8009-1c348a819426 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.260941 Oct 27 13:27:02.667863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 197/402] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:02 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:02.674158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:02.681460 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:02.697934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.698432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.698877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.699598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:02.700062 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:02.700517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:02.734213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.742904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a1b6834c-da81-40c9-bc1a-c60a0b8a7ec5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1222 microversion: 2.1 time: 0.132001 Oct 27 13:27:02.742904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 206/403] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:02 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1222 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:02.794491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:02.803034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e002b65b-d923-43a6-817d-e319ac5562a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1244 microversion: 2.1 time: 0.133660 Oct 27 13:27:02.804277 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 198/404] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:02 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:03.623600 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:03.624393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:03.633502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.634197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.634742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.635636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.636574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.637085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.693132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:03.693857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:03.701250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.701744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.702415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.703139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.703601 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.704029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.817198 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:03.829354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:03.831544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:03.833674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-813d9401-ebf6-486b-8785-4edb377bdd96 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.213489 Oct 27 13:27:03.843480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 207/405] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:03 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:03.849111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:03.850011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:03.858111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.859419 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.859996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.860986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.861469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.861881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.902781 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:03.912719 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c66d6a27-9cba-4d2b-9dd4-5b8d72310830 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.223362 Oct 27 13:27:03.914011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 199/406] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:03 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:03.921638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:03.922333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:03.929567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.930424 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.931218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.932280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:03.933082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:03.934286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:03.975466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:03.983909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-309c1bf0-41a4-44b9-9297-527a8971b34e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1222 microversion: 2.1 time: 0.145407 Oct 27 13:27:03.984736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 208/407] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:03 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:04.019801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:04.030094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-05cc4f95-a000-4b5b-9ebb-cb64199575b5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1244 microversion: 2.1 time: 0.113089 Oct 27 13:27:04.031139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 200/408] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:03 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1244 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:04.876989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:04.886074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:04.896326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:04.896326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:04.896326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:04.897596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:04.898415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:04.899180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:04.942266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:04.942266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:04.947278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:04.948171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:04.949069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:04.950795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:04.951274 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:04.951959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:05.098226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.108465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.110269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.111596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2c0904ff-8ce6-4024-8655-cf12e04f030e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.240346 Oct 27 13:27:05.113068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 209/409] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:04 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:05.118016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:05.118845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:05.125289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:05.125786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:05.126224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:05.127099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:05.127507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:05.128750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:05.173438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.183410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6c353a93-234c-4a3f-a8d2-eca6cb969456 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.248046 Oct 27 13:27:05.183997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 201/410] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:04 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:05.192317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:05.192317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:05.199277 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:05.199820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:05.200537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:05.201683 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:05.203492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:05.203987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:05.205603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.214207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-48a919d9-a251-440f-ac7b-1c91c72b31fd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1222 microversion: 2.1 time: 0.099933 Oct 27 13:27:05.214847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 210/411] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:05 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:05.279852 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:05.288916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fdb2c19b-db29-4855-9e10-f2121c168556 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1244 microversion: 2.1 time: 0.102843 Oct 27 13:27:05.289721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 202/412] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:05 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1244 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:06.142065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:06.142770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:06.149956 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.150473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.151007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.151726 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.152340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.152729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.210395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:06.211002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:06.217856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.218349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.219477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.220612 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.221017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.221757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.380330 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.394925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.397459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.399459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b0fa3336-adc4-432e-afa9-0f00a50dfb41 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.261699 Oct 27 13:27:06.415410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 211/413] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:06 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:06.433640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:06.434282 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:06.442536 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.443043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.443488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.444213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.444699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.445151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.463954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.472518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-44948078-29ca-4b36-96cb-373e306e416d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.267345 Oct 27 13:27:06.475233 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 203/414] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:06 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:06.478478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:06.479224 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:06.485459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.485459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.486708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.487536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:06.488410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:06.488794 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:06.557834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.569287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b5a2c794-20f8-4737-b836-ef1eea256ff2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1222 microversion: 2.1 time: 0.152317 Oct 27 13:27:06.570076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 212/415] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:06 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1222 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:06.574758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:06.578498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:06.583960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cab1954a-d8cf-4b8d-88aa-e8ae4e9c31ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1244 microversion: 2.1 time: 0.109825 Oct 27 13:27:06.584608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 204/416] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:06 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1244 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:07.445354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:07.446469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:07.457527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.458298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.459426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.460797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.461914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.463150 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.504805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:07.505510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:07.517777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.518086 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.519254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.520109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.520725 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.521216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.644716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.670149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.672852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.675284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2939e132-a98d-4eef-9683-9c01ec2161dd tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.237029 Oct 27 13:27:07.676532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 213/417] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:07 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:07.696476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:07.699957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:07.709914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.710707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.711439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.712667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.713443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.714978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.722392 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:07.754448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.767360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-625fc061-60b7-47b9-8778-73eb878fe1b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.266985 Oct 27 13:27:07.777627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 205/418] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:07 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:07.786089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:07.791012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:07.796439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.797149 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.797704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.798678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:07.799209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:07.799810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:07.807050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.815538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9da619fc-fd9e-49ef-b616-77a40ba82231 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1222 microversion: 2.1 time: 0.137578 Oct 27 13:27:07.824460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 214/419] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:07 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1222 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:07.894904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:07.902826 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-45b9653d-4356-4eec-9133-191d33779452 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1244 microversion: 2.1 time: 0.123775 Oct 27 13:27:07.903511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 206/420] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:07 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1244 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:08.705294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:08.705946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:08.711996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:08.712575 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:08.713182 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:08.713966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:08.714458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:08.714905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:08.801579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:08.802256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:08.809821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:08.810387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:08.810916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:08.811779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:08.812349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:08.812831 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:08.943689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:08.969948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:08.976287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:08.981047 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-58d92b49-ff8c-4fff-bca1-18302846d2a1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.279716 Oct 27 13:27:09.005134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 215/421] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:08 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:09.005134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:09.005134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:09.024827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:09.028362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:09.029151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:09.030699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:09.031384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:09.032074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:09.099811 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:09.113579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-efa3ef7a-9cdf-4632-8afc-768f816534ba tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.316713 Oct 27 13:27:09.128778 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 207/422] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:08 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:09.137552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:09.138510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:09.144003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:09.147557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:09.149406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:09.150159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:09.151206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:09.151744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:09.152175 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:09.154849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-86438982-e834-4179-b60c-be0eb044b840 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1214 microversion: 2.1 time: 0.161186 Oct 27 13:27:09.155695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 216/423] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:08 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1214 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:09.248569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:09.257593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-995d35d8-dfed-4126-8494-41d2e480e743 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1236 microversion: 2.1 time: 0.127364 Oct 27 13:27:09.270344 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 208/424] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:09 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1236 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:10.014773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:10.015383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.022216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.022699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.023132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.023837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.024309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.024732 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.146951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:10.147761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.154314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.154812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.155253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.155957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.156456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.156888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.191616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.200299 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.201983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.203362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b4b2cbae-e681-48d8-8dea-1eef75ac2f94 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.192426 Oct 27 13:27:10.203947 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 217/425] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:10 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:10.208591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:10.209198 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.215497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.215987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.216456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.217157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.217615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.218040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.282197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.290182 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f2312310-cfeb-44bf-a146-36d0883a2e23 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1214 microversion: 2.1 time: 0.085196 Oct 27 13:27:10.290866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 218/426] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:10 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:10.309125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:10.309740 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.323284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.323767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.324202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.325003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.325461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.325889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.331096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.340345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0c2ab5a8-291d-4198-a340-8a9eb087e283 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.197065 Oct 27 13:27:10.340938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 209/427] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:10 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:10.346649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "628a6e1c-80c7-451c-86b6-6bd0f82362a1"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:10.349534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.365376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.365990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.366526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.368513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.368973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.370014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.425669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:10.436295 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3ffb2fc0-ef5a-4190-853e-17da05bd481b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1236 microversion: 2.1 time: 0.143931 Oct 27 13:27:10.443848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 219/428] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:10 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:10.669735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:10.670236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:10.676870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.677355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.677789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.678501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:10.678950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:10.679372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:10.813523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lazy-loading 'services' on Instance uuid a91179d4-4294-46cc-b7c1-6aaf60a1ef45 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:27:10.868671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:10.940713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5d6a7969-605a-48bf-bef5-a4d6b9961882 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments/c51fc858-0387-4318-a1e7-61f4239987f0" status: 202 len: 0 microversion: 2.1 time: 0.274251 Oct 27 13:27:10.941318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 220/429] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:27:10 2022] DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments/c51fc858-0387-4318-a1e7-61f4239987f0 => generated 0 bytes in 276 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:27:10.944917 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:11.236548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:11.237258 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:11.243508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.243993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.244469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.245167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.245624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.246052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.417852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.428413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.429850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.431093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c43b20f3-36d3-4739-aa92-5ba1fba4ca82 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.198841 Oct 27 13:27:11.431648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 221/430] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:11 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:11.436104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:11.444135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:11.483406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.484151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.484998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.485876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.486394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.487411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.518365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=8 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:11.570300 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-11547bd0-52ec-488f-9428-68ab661b3d89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.227893 Oct 27 13:27:11.571251 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 210/431] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:27:10 2022] POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 194 bytes in 1229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:11.576833 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:11.577788 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:11.585396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.585886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.586325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.587029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.587139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.587483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.587913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.598814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-48dc5406-f6fd-4dae-9e5d-5ed5a46772f8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1214 microversion: 2.1 time: 0.165747 Oct 27 13:27:11.612452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 222/432] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:11 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1214 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:11.612719 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=8 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:11.617200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:11.618455 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:11.629803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.630656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.631344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.632871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:11.633710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:11.634615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:11.703833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.711459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6c3ab603-0636-4482-bc52-3ca08e4aa04b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1292 microversion: 2.1 time: 0.110784 Oct 27 13:27:11.712033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 223/433] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:11 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1292 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:11.747274 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:11.757678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f1fbabd3-5de5-47df-84a2-bdddf4b111d1 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.184796 Oct 27 13:27:11.758261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 211/434] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:11 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:12.461092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:12.462475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:12.477161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.477943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.479579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.480940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.481906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.482647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.625307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:12.626079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:12.647545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.650974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.651726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.652534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.653003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.653428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.814456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:12.825991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7f3e619f-7eb5-48d1-8720-8ec6255b82fc tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1270 microversion: 2.1 time: 0.205877 Oct 27 13:27:12.826886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 212/435] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:12 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1270 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:12.832635 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:12.833498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:12.856723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.857447 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.857920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.859825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.860433 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.861135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.938623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:12.947681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-86007d54-6eda-452e-94bd-5efc61c93bf6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1298 microversion: 2.1 time: 0.119533 Oct 27 13:27:12.948448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 213/436] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:12 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:12.954231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:12.955257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:12.973432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.976309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.977092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:12.978146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:12.978979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:12.979727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.011096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.023556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.025025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.026244 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b470124f-05be-4b04-953c-097ae332e494 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.572503 Oct 27 13:27:13.026817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 224/437] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:12 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:13.136655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:13.143963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.144604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.145242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.173005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Going to try to stop instance {{(pid=118773) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 27 13:27:13.224352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cd12f2b2-3c33-40cc-935e-800aaaf6e7c4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.093388 Oct 27 13:27:13.225048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 225/438] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:27:13 2022] POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:27:13.234317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:13.235038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:13.241911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.242436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.242897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.243651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.244145 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.244625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.475908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.484213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.488741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-53d0501f-95bb-46ab-9e47-5fcfe5ac66cb tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.258806 Oct 27 13:27:13.508275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 226/439] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:13 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:13.510627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2e4fae9b-c28b-44f1-81ab-46287b3a9b81 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.560820 Oct 27 13:27:13.511225 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 214/440] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:12 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:13.855933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:13.856767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:13.869992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.871045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.872353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.873452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.874109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.875786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.946012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:13.954408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f2845e04-afeb-48dc-b238-7f6959763bb9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1276 microversion: 2.1 time: 0.106549 Oct 27 13:27:13.955223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 227/441] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:13 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1276 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:13.975576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:13.976515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:13.983734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.984430 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.984973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:13.985799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:13.986313 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:13.987628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.054040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:14.054656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:14.060759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.061238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.061671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.062400 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.062880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.063299 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.082014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.090374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3628d34c-2fc3-44d7-8134-6b8c4987751e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1298 microversion: 2.1 time: 0.119313 Oct 27 13:27:14.091188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 215/442] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:13 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1298 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:14.233227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.245336 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.247183 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.248834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0cfd6eb9-62f7-4871-a01d-b01aab8ebbe8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.199937 Oct 27 13:27:14.249832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 228/443] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:14 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:14.517208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:14.518438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:14.525525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.526110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.526821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.529292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.538240 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:14.539479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:14.540842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.541478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.554864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.555652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.560008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.561171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.561837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.562493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.568868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:14.729952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.741382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-661d6310-e212-422f-be13-b1dd0fd1ad80 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.209855 Oct 27 13:27:14.741974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 229/444] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:14 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:14.914517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:14.922880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2bd73097-b62f-451a-a10a-01f46cb2b0ef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.410058 Oct 27 13:27:14.923384 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 216/445] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:14 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:14.981542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:14.982946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:14.991807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.992488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.993230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:14.994167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:14.994759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:14.995343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.119294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:15.121289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:15.130188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.132281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.133064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.134137 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.135099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.135829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.184396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.192915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-66bb8825-1495-40c4-90af-d93f7ebd308d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.218705 Oct 27 13:27:15.193499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 230/446] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:14 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:15.279338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:15.280425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:15.287918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.288725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.289391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.290414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.291162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.291911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.436405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.453177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-29c34960-1b9e-4226-9743-784e06946aaf tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.338522 Oct 27 13:27:15.453994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 217/447] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:15 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:15.456350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.466973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.468788 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.470155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f6c93bb5-6502-4868-aa6b-ab71c01d5285 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.195181 Oct 27 13:27:15.470303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "name": "network-vif-plugged", "status": "completed", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:15.470792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 231/448] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:15 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:15.478575 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:15.485760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.485760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.487106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.503032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] Creating event network-vif-plugged:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:27:15.509574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-fee6a2cb-64ff-4ed4-8984-9bc049417921 req-bdbf69b4-e03a-4790-9778-a657142c0e97 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045266 Oct 27 13:27:15.510442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 218/449] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:15.765673 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:15.766387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:15.773421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.774473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.775227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.776438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.777210 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.778240 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.832810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28008920-1a00-44c9-9036-ef5c8cde50c2", "tag": "f942fce4-3fce-4282-9e21-4c881b31394c"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:15.846857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.847337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.847962 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.863077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] Creating event network-changed:f942fce4-3fce-4282-9e21-4c881b31394c for instance 28008920-1a00-44c9-9036-ef5c8cde50c2 on hv-cinder-86243 Oct 27 13:27:15.868222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-1a926a89-de75-4958-8923-4a879d7c3c8f req-a4e72fa0-4d7a-4229-bf76-f3072263e152 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043216 Oct 27 13:27:15.869110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 219/450] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:15.950050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:15.951573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:15.977343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.978003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:15.978470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.979203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.980010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:15.980625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:15.981370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:15.988299 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-db4e920e-86b3-403a-b801-df4394bdbc4c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.226976 Oct 27 13:27:15.989415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 232/451] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:15 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:16.221980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:16.222503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:16.229089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.229727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.230235 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.231181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.231648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.232071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.272969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.285061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6ab34e55-2a1b-4d8c-932c-b76e18bd7a27 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.340679 Oct 27 13:27:16.286048 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 220/452] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:15 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:16.398154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.410420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9b43b71c-567f-4c68-9168-6d4f4d7b46ac tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.192220 Oct 27 13:27:16.411015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 233/453] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:16 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:16.483865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:16.484516 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:16.492053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.492628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.493070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.493778 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.494244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.494783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.497111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:16.497765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:16.503968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.504500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.504929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.505619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:16.506064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:16.506774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:16.515545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:16.686711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.698200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5a9d6a21-63bd-4f75-86ff-0286613f24ed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.218577 Oct 27 13:27:16.698914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 221/454] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:16 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:16.733061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.743012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.744987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:16.747095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-351d0ec3-e257-480d-a503-cb16d4e5f190 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.253655 Oct 27 13:27:16.749825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 234/455] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:16 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:17.013067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:17.014134 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:17.024676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.025422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.026079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.027163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.027914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.028634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.174172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.185779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a17a266c-68b9-4989-968a-c75cd4838843 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1357 microversion: 2.1 time: 0.177710 Oct 27 13:27:17.186677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 222/456] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:17 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:17.310050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:17.311359 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:17.319891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.320477 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.321217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.322045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.322512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.323034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.435108 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:17.436645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:17.444347 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.444938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.445678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.447073 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.447844 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.448615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.484108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.493753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d06eda68-5b5a-49a7-95bd-f7bee99a4188 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.187852 Oct 27 13:27:17.494310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 235/457] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:17 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:17.715428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.722623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:17.723786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:17.734695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.735400 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.735747 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.737139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.737874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.738234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.741680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b24a8645-f6fb-4589-b341-26220c50f280 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.311013 Oct 27 13:27:17.746887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 223/458] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:17 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:17.781645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:17.782703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:17.794431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.795820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.796905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.798011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.799170 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.799754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.954560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.962927 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d814bdad-c210-4bf4-86a7-654267ad3bb5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.245058 Oct 27 13:27:17.963755 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 236/459] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:17 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:17.963874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.968144 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ceb3538d-52bc-44df-846e-39f0819fc18a", "tag": "50c86583-c5f2-4a50-b745-db2d95e82e4d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:17.983504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:17.983981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:17.984441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:17.989787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.991324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:17.992626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b13531f1-9396-480f-b867-5c9e03d7ebc6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.218160 Oct 27 13:27:17.993369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 224/460] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:17 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:17.996980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] Creating event network-changed:50c86583-c5f2-4a50-b745-db2d95e82e4d for instance ceb3538d-52bc-44df-846e-39f0819fc18a on hv-cinder-86243 Oct 27 13:27:18.001902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-19e51ff6-de17-41ce-899d-f66aeb6f6e63 req-7966e8fe-643a-4c0e-bda5-ce8e686aad06 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037158 Oct 27 13:27:18.002510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 237/461] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:18.216727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.217303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.224182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.224707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.225147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.225869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.226323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.226748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.373020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.384829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-11650639-c9a8-44cf-af7f-61b8dfc12ed0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1548 microversion: 2.1 time: 0.171803 Oct 27 13:27:18.385805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 225/462] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1548 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:18.409384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.409384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.415715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.416267 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.416659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.417383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.417828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.418340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.521631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.522056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.528458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.528978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.529453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.530195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.530670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.531515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.572757 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.580854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2ce9774f-3539-47fd-8a47-065effa2bac3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1548 microversion: 2.1 time: 0.176470 Oct 27 13:27:18.581439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 238/463] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1548 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:18.603882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.608855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.609636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Searching by: {'deleted': False, 'project_id': '52552d69672a4677bd52c847cceec247'} {{(pid=118773) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 27 13:27:18.617475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.617954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.618519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.619518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.619962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.620424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.694157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.702292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9921e796-1452-4880-b835-70a127573f07 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.185206 Oct 27 13:27:18.702912 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 226/464] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:18.712787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.multi_cell_list [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118773) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 27 13:27:18.772453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.773408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.780551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.781345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.781830 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.782608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.783662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.784498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.811497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ede9818f-b74b-459d-b9d0-edfacd5bcb5d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.211470 Oct 27 13:27:18.812215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 239/465] 10.222.0.48 () {58 vars in 1125 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:27:18.825525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.826019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.827968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:18.834526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.835014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.835444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.836146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.836624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.837041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:18.927856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.937092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f74caade-7c73-48b4-a1b8-dc72a27316e5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.168088 Oct 27 13:27:18.938060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 227/466] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:18.989640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:18.990404 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:18.990509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:18.998778 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:18.999276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:18.999718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.000466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.000652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-98749642-9fd3-44e1-9636-6cfdedd23346 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1548 microversion: 2.1 time: 0.178888 Oct 27 13:27:19.000924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.001355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.001520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 240/467] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1548 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:19.018532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:19.019178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:19.025352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.025835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.026272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.026975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.027772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.027918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.180763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:19.190285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6e2ee2c7-2f91-43fe-951c-ba94efdc6379 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.206011 Oct 27 13:27:19.190881 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 228/468] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:18 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:19.230458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:19.246068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:19.248202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:19.249656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8e1c68e7-3365-433d-a080-a423a8c1a071 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.234954 Oct 27 13:27:19.250480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 241/469] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:19 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:19.492821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "name": "network-vif-plugged", "status": "completed", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:19.508479 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.509111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.509891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.531173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] Creating event network-vif-plugged:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:27:19.539895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-201a5196-2fe9-4f79-a8ad-8e2102d81b41 req-7ff30c34-9ac0-4d2e-b19f-8fad26f295bc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054055 Oct 27 13:27:19.540939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 229/470] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:19.726256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:19.727011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:19.733477 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.733967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.734402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.735106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.735556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.735973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.911980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:19.917794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d8263e20-9e23-47cb-b728-a5d537dbf693 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.195484 Oct 27 13:27:19.918388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 242/471] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:19 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:19.964465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:19.965437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:19.972594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.973131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.973575 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:19.974280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:19.974733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:19.975154 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.107423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:20.115257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c710fdc5-66cf-4bbb-b9bb-f824921e1a5d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.155013 Oct 27 13:27:20.115825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 230/472] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:19 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:20.219780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:20.220555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:20.226707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.227534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.228152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.229214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.229682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.230326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.276899 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:20.276899 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:20.282634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.283148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.283584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.284310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.284765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.285282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.371412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:20.380718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-174b28ec-6ca1-43e4-91f7-2d0812a682d4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.165218 Oct 27 13:27:20.381584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 243/473] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:20 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:20.427152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:20.435925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:20.437407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:20.438573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7594658a-f4e7-4382-8281-7bee7445e195 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.166562 Oct 27 13:27:20.439671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 231/474] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:20 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:20.719207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f0306296-f98f-464f-994c-97ca5c819fc6"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:20.721698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:20.727584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.728133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.728523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.729217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.729675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.730147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.943202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:20.945131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:20.958996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.959688 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.960127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:20.964987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:20.965694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:20.966278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.084000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:21.103639 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9f3b1137-6a0b-4cba-9b4e-b8ac84f647b6 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.387161 Oct 27 13:27:21.105323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 244/475] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:27:20 2022] POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments => generated 194 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:21.153255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:21.155172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:21.167508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.168269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.168968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.170847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.171555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.172401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.193682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.202640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3f928042-af1e-4f95-8de6-ebd42136e7a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.264780 Oct 27 13:27:21.204702 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 232/476] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:20 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:21.348344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.357087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c43ecff5-0aa8-4536-921a-8c4c5ef5207f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.215971 Oct 27 13:27:21.358158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 245/477] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:21 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:21.407441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:21.408674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:21.419842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.421225 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.421841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.422733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.424030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.424880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.444493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:21.447804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:21.458068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.460046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.460046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.460900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.461717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.462472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.503464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'flavor' on Instance uuid d2278934-664f-48c4-be2a-35f1cfa1844a {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:27:21.604975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.616579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bcc0668c-b407-4083-b9d3-37dceb967fdd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.215160 Oct 27 13:27:21.618095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 233/478] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:21 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:21.637071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:21.637674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:21.647361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.648509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.649625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.650368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.650815 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.651401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.698399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6c98b146-3972-488d-a03e-c6b467954f27 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/action" status: 200 len: 32 microversion: 2.1 time: 0.258212 Oct 27 13:27:21.699163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 246/479] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:27:21 2022] POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/action => generated 32 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:27:21.704774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb3538d-52bc-44df-846e-39f0819fc18a", "name": "network-vif-plugged", "status": "completed", "tag": "50c86583-c5f2-4a50-b745-db2d95e82e4d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:21.714910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.715700 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.716371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.730783 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] Creating event network-vif-plugged:50c86583-c5f2-4a50-b745-db2d95e82e4d for instance ceb3538d-52bc-44df-846e-39f0819fc18a on hv-cinder-86243 Oct 27 13:27:21.738990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-ca1e67e4-46dc-4150-a5fe-d3d2f4ce98d8 req-fb87bc8b-0d46-43a3-96e3-5d188c684cbb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037707 Oct 27 13:27:21.739942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 247/480] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:21.748566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:21.750092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:21.759825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.760625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.761320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.762412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:21.763367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:21.764046 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:21.804503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.813576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.815055 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.816215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2ac59261-30cf-41c8-b41f-8207860ef3b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.196338 Oct 27 13:27:21.816867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 234/481] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:21 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:21.927681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:21.936538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a9e7bee5-c424-4036-8505-417d87f8473d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.194852 Oct 27 13:27:21.937124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 248/482] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:21 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:22.235005 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:22.237440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:22.246332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.247249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.248167 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.249247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.249944 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.250968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.388831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:22.389607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:22.396436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.397012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.397515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.398349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.398873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.399465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.403748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:22.412186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7870dec1-5600-49eb-a496-f81deefe5282 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.187368 Oct 27 13:27:22.412801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 235/483] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:22 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:22.542026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:22.550750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d43307bf-6073-4423-a16e-bac1e2ac3b4e tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.165695 Oct 27 13:27:22.551645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 249/484] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:22 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:22.643474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:22.644407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:22.656835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.657195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.657640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.659134 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.659406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.659850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.801488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:22.809583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-723d5396-f73e-41c1-87c9-6ff3fce3ba2d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.171613 Oct 27 13:27:22.810331 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 236/485] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:22 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:22.844203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:22.844980 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:22.851987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.852548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.853041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.853782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.854208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.854632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.960888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:22.962223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:22.968079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.968732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.969264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:22.970155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:22.971924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:22.971924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.020574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.030752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.032373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.034393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3856a655-3b00-4321-8f79-edd6e60396b9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1808 microversion: 2.20 time: 0.194566 Oct 27 13:27:23.035291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 250/486] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:22 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1808 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:27:23.120037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.129870 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-64ad3b3a-92c7-40c3-be91-9cff2acce71d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.173226 Oct 27 13:27:23.130463 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 237/487] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:22 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:23.438019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:23.438632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:23.445077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.445569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.446260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.447275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.447739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.448202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.573812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:23.574579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:23.582066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.582549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.582985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.583698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.584163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.584624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.588099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.598891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3f27dc49-1396-4f6b-a518-cbe2bc86086b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1675 microversion: 2.1 time: 0.164762 Oct 27 13:27:23.599481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 251/488] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:23 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:23.737267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:23.741237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:23.746437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ac52d98e-33ed-4e79-867f-cdecaf7542d2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1318 microversion: 2.1 time: 0.176417 Oct 27 13:27:23.747012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 238/489] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:23 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:23.754824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28008920-1a00-44c9-9036-ef5c8cde50c2", "name": "network-vif-plugged", "status": "completed", "tag": "f942fce4-3fce-4282-9e21-4c881b31394c"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:23.766481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.768268 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.768933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.780825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] Creating event network-vif-plugged:f942fce4-3fce-4282-9e21-4c881b31394c for instance 28008920-1a00-44c9-9036-ef5c8cde50c2 on hv-cinder-86243 Oct 27 13:27:23.786492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-a29564c0-dc48-4d0f-97f4-480a843a06f4 req-cc5ae369-fc7b-41cb-b792-5f5c2dd43e98 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035610 Oct 27 13:27:23.787092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 252/490] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:23.834304 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:23.835003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:23.842460 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.842977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.843414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:23.844117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:23.844592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:23.845014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.039215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.047102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-58e5f6e0-05d2-4619-bdea-50c289c04971 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.217859 Oct 27 13:27:24.047678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 239/491] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:23 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:24.061354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:24.062079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:24.069086 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.069569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.070008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.070699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.071149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.071563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.154512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:24.155121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:24.162417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.162913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.163354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.164061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.165131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.165131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.214865 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.232004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.233538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.234738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-66f7487a-d200-477c-a340-5d730b0c5194 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1795 microversion: 2.20 time: 0.177858 Oct 27 13:27:24.235303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 253/492] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:27:24 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1795 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:27:24.312888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.322470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7eb984a3-7e68-46a1-a84d-df246485b00b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.171734 Oct 27 13:27:24.323049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 240/493] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:24 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:24.622675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:24.623292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:24.630480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.630966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.631648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.632556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.633008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.633428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.780778 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:24.781395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:24.788775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.789262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.789696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.790408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.790864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.791284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.799401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.812115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bc5d3aed-3c57-4a27-baaf-a4c9cf07ad03 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1652 microversion: 2.1 time: 0.192959 Oct 27 13:27:24.813179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 254/494] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:24 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1652 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:24.836865 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:24.843144 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.843638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.844078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.869953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Going to try to start instance {{(pid=118773) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 27 13:27:24.919277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-dd26bd56-f207-4d23-a67a-564be25899d0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action" status: 202 len: 0 microversion: 2.1 time: 0.086352 Oct 27 13:27:24.919892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 255/495] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:27:24 2022] POST /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:27:24.929687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:24.930430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:24.940505 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.941538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.942187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.943439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:24.943927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:24.944298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:24.945070 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:24.952252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1fe1c8da-05d7-405a-a482-357474f2bbd8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1506 microversion: 2.1 time: 0.175396 Oct 27 13:27:24.953033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 241/496] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:24 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1506 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:25.069828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:25.070455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:25.077034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:25.077450 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:25.077891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:25.078603 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:25.079061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:25.079534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:25.143291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:25.152680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0047bf51-be01-4f2f-ae69-ce4b32ea82ba tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1661 microversion: 2.1 time: 0.227000 Oct 27 13:27:25.153381 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 256/497] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:24 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1661 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:25.242314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:25.252180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-257bb454-e0b9-4ace-bc6f-16886e8b0621 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.185548 Oct 27 13:27:25.252930 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 242/498] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:25 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:25.346715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:25.347720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:25.357372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:25.358166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:25.358955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:25.360194 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:25.361523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:25.362520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:25.528529 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:25.537336 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7b9f750e-6abd-475f-91f5-a4b0b0f58317 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.195048 Oct 27 13:27:25.537929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 257/499] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:25 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:26.177196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:26.177975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:26.184177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.184698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.185114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.185802 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.186250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.186666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.283652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:26.284710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:26.295683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.296510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.297432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.299029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.299029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.299029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.348734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:26.359289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d9494a65-fca9-4703-bc78-5eb269f3c8a1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1661 microversion: 2.1 time: 0.186538 Oct 27 13:27:26.360282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 243/500] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:26 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1661 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:26.457964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:26.465972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-be982e69-c107-4aba-ae09-2cb4b414b3fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1366 microversion: 2.1 time: 0.194487 Oct 27 13:27:26.466549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 258/501] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:26 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1366 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:26.564855 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:26.565898 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:26.573513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.574888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.575748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.576576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:26.577738 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:26.577738 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:26.717077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:26.725581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e4c61456-c904-4e35-b970-f64a91137edd tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.166938 Oct 27 13:27:26.726160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 244/502] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:26 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:27.383124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:27.383687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:27.390125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.390607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.391040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.391794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.392340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.392769 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.488825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:27.489425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:27.496131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.496807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.497241 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.498163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.498637 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.499070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.526013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:27.529616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:27.535664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b6003494-deff-4cec-b20d-770fdca2f478 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1661 microversion: 2.1 time: 0.156690 Oct 27 13:27:27.536290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 259/503] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:27 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:27.660261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:27.669588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d2b31434-a4d6-46c8-aa39-dffd1e564f2c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1557 microversion: 2.1 time: 0.185004 Oct 27 13:27:27.670098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 245/504] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:27 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1557 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:27.694441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:27.695034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:27.701904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.702274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.702707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.703428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.703881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.704453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.749743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:27.750362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:27.757823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.758666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.759328 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.760129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:27.760627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:27.761082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:27.785631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-48686a03-96ff-4dac-b996-f9731e70c8ac tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095324 Oct 27 13:27:27.786322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 260/505] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:27:27 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:28.317214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:28.326058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3d27c6e9-3269-4dae-87dd-85cd95af8f35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.580069 Oct 27 13:27:28.326647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 246/506] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:27 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:28.560500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:28.561120 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:28.567289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:28.567697 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:28.568133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:28.569055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:28.569871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:28.570296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:28.653065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:28.760789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:28.770783 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-48ea651d-86e1-4572-9e7f-6dfc9a891bb1 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1665 microversion: 2.1 time: 0.215520 Oct 27 13:27:28.772125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 261/507] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:28 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1665 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:29.141189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28008920-1a00-44c9-9036-ef5c8cde50c2", "tag": "f942fce4-3fce-4282-9e21-4c881b31394c"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:29.151409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:29.151896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:29.152355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:29.166360 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] Creating event network-changed:f942fce4-3fce-4282-9e21-4c881b31394c for instance 28008920-1a00-44c9-9036-ef5c8cde50c2 on hv-cinder-86243 Oct 27 13:27:29.171403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-4182ce07-99e7-4f90-8e7d-4b623e3095e4 req-d98e3c76-b7a9-471d-b14f-ae4f1bbf84a3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033860 Oct 27 13:27:29.172029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 247/508] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:29.348905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:29.349512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:29.356981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:29.358647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:29.359723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:29.360613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:29.361193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:29.361633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:29.581314 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:29.597308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-75227e28-6128-40d4-b557-aea01f587cee tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.252203 Oct 27 13:27:29.598119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 262/509] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:29 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:30.014812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:30.015601 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:30.023095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:30.023589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:30.024027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:30.024761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:30.025213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:30.025638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:30.176922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:30.185380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bbccada9-4de5-4ea6-90e4-a6f37478d0bd tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1594 microversion: 2.1 time: 0.174862 Oct 27 13:27:30.185962 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 248/510] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:30 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1594 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:30.624946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:30.626614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:30.634199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:30.634781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:30.635407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:30.636122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:30.636607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:30.637231 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:30.784313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:30.798953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-456fd2e8-8fda-4d46-8f16-987aa5f9e0c1 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.179940 Oct 27 13:27:30.800742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 263/511] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:30 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:31.832074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:31.832672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:31.839855 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:31.840904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:31.841508 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:31.842403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:31.843497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:31.844094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:32.076389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:32.086387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-20d2ef20-cdef-4423-87f6-d5641a55f383 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.258775 Oct 27 13:27:32.092986 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 249/512] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:31 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:32.123128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:32.137802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:32.138492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:32.139218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:32.153077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] Creating event network-changed:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:27:32.158924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-3275bf9f-4648-4313-a8ae-549492d030f3 req-1a07ae03-1f95-40a6-a79e-8134f1bd5e7d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040080 Oct 27 13:27:32.159773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 264/513] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:33.111699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:33.112376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:33.120354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:33.121007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:33.121598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:33.123218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:33.126386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:33.127220 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:33.367806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:33.377231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-de961956-8047-4d32-ab6e-f96dbb8b33d4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.269513 Oct 27 13:27:33.378682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 250/514] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:33 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:33.835582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1874299280"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:33.836280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:33.842773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:33.843266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:33.843711 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:33.845040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:33.845553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:33.845979 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:33.980881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.network.security_group_api [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Adding security group 38930577-87d3-47b3-8939-1f9b79da7281 to port 5914531a-8c3d-4f54-ab34-59d0c72ab0a9 Oct 27 13:27:34.336020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3d846a67-f5f6-4d1d-9771-153957062879 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action" status: 202 len: 0 microversion: 2.1 time: 0.505212 Oct 27 13:27:34.336671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 265/515] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:27:33 2022] POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action => generated 0 bytes in 507 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:27:34.346351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:34.346838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:34.347432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:34.355782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:34.356917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:34.357674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:34.358502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:34.358804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:34.359322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:34.359571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:34.360094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:34.360605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:34.372473 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] Creating event network-changed:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:27:34.378362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-2f5f541a-26e7-4096-9603-5954824c2c41 req-99e8736a-da64-45c4-8cd9-fae1eb36aec1 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037727 Oct 27 13:27:34.379137 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 251/516] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:27:34.408161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:34.409482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:34.420974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:34.425395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:34.428776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:34.429626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:34.430169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:34.430662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:34.599737 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:34.610915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f21aa32c-a989-47dd-b10e-5db7a88471d9 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1760 microversion: 2.1 time: 0.268797 Oct 27 13:27:34.611491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 266/517] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:34 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1760 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:34.612214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:34.623819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-645cb71f-10af-4805-be57-c77dfcef8586 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.223328 Oct 27 13:27:34.629476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 252/518] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:34 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:35.647602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:35.648261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:35.654767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:35.655249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:35.655683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:35.656566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:35.657146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:35.657575 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:35.798003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:35.806188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8c5fe261-245a-4400-985a-96907bbc6612 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.162521 Oct 27 13:27:35.806848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 267/519] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:35 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:36.830746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:36.831358 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:36.837911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:36.838397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:36.838838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:36.839541 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:36.840001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:36.840455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:36.974276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:36.982449 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6eef177a-16b6-40e9-a1df-6de4fb43b220 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.156234 Oct 27 13:27:36.983021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 253/520] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:36 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:38.007057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:38.007620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:38.015035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:38.015523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:38.015964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:38.017285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:38.017751 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:38.018185 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:38.165170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:38.173553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-92823d7a-432f-4b27-bd36-b56d0ca6d2b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.170664 Oct 27 13:27:38.174136 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 268/521] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:38 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:39.197401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:39.198009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:39.204642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:39.205121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:39.206188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:39.206942 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:39.207411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:39.207843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:39.358925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:39.368179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a78492c7-4833-46b9-a1f6-51b2a7ffb7de tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.174618 Oct 27 13:27:39.368793 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 254/522] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:39 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:40.393093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:40.393712 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:40.400469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:40.400960 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:40.401397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:40.402107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:40.402603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:40.402971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:40.538026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:40.548033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4471e403-ecc9-4913-a034-795d2a53953a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.158749 Oct 27 13:27:40.548661 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 269/523] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:40 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:41.571763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:41.572325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:41.578673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:41.579150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:41.579579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:41.580284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:41.580736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:41.581184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:41.722663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:41.731022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c44ae7a8-5e89-44c8-90ee-23ed8f408f0f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.163158 Oct 27 13:27:41.731592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 255/524] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:41 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:42.755445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:42.756219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:42.763796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:42.764312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:42.764748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:42.765444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:42.766497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:42.766925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:42.903809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:42.912087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-283da30e-3f31-4703-9a9b-3a8ae5ce10e5 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.160576 Oct 27 13:27:42.912671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 270/525] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:42 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:43.935883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:43.936538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:43.943362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:43.943844 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:43.944303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:43.945006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:43.945453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:43.945871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:44.096082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:44.099735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:44.105608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-507cc90f-96aa-43df-940a-db49ce455c78 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.173709 Oct 27 13:27:44.106185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 256/526] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:43 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:45.131438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:45.132211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:45.139168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:45.139652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:45.140260 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:45.140976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:45.141995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:45.142574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:45.294284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:45.303099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-49168420-c912-4af7-9b1c-2091762cfef8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.175971 Oct 27 13:27:45.303662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 271/527] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:45 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:45.729167 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5d90f719-065e-43e6-9b4d-5d460514a730", "device": "/dev/sdb"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:45.732060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:45.734597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=78 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:45.740532 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:45.741019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:45.741455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:45.742158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:45.742610 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:45.743079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:46.327518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:46.328224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:46.334971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:46.335461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:46.335899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:46.336636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:46.337090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:46.337516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:46.478595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:46.489499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-79e423d6-e768-49d8-83bf-d41714681a9a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.165668 Oct 27 13:27:46.490109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 272/528] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:46 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:27:46.661094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-79300e3c-98d0-4b42-bc8b-3aac605cc127 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "POST /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.935657 Oct 27 13:27:46.661704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 257/529] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:27:45 2022] POST /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a/os-volume_attachments => generated 194 bytes in 937 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:47.513414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:47.514032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:47.521236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:47.521727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:47.522194 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:47.523020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:47.523369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:47.523793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:47.658285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:47.666380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3698ee80-ac5c-4c41-b512-8e8cee746c44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1733 microversion: 2.1 time: 0.157394 Oct 27 13:27:47.666943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 273/530] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:47 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:48.692723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:48.693423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:48.699638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:48.700122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:48.700587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:48.701283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:48.701735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:48.702159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.105113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:49.113858 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e7b99423-9269-4553-bd11-f8fc87ad116a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1713 microversion: 2.1 time: 0.426639 Oct 27 13:27:49.114426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 258/531] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:48 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1713 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:49.225946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:49.226488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:49.228964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=68 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:49.234306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.234813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.235246 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.235985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.236475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.236894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.317884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] HTTP exception thrown: Cannot 'detach_volume' instance d2278934-664f-48c4-be2a-35f1cfa1844a while it is in vm_state rescued Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Request method failure captured: Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments/628a6e1c-80c7-451c-86b6-6bd0f82362a1 HTTP/1.1 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1xAtUYrOex98HvjYZlXP0lCdqcKA9lU9x9gpDqxomiQllgjNl3CeHtaWElMpZyLhkIVdMNzfyGu3XpYubic1m1__Hlyxu7bbBlLyrigpCJI1GH_ZSqLd8fYGv4HrHQV_w1OhNa5mBqN3L2RrEvavlCQcpysTSqHq8jqovhh8dDCQ Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:27:49.320110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 97d696ea0031417d8a1a0b8471c26579 Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:27:49.321729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Cannot 'detach_volume' instance d2278934-664f-48c4-be2a-35f1cfa1844a while it is in vm_state rescued Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'server_id': 'd2278934-664f-48c4-be2a-35f1cfa1844a', 'id': '628a6e1c-80c7-451c-86b6-6bd0f82362a1'} Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d2278934-664f-48c4-be2a-35f1cfa1844a in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:27:49.322556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d2278934-664f-48c4-be2a-35f1cfa1844a while it is in vm_state rescued Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d2278934-664f-48c4-be2a-35f1cfa1844a while it is in vm_state rescued Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:27:49.324011 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Returning 409 to user: Cannot 'detach_volume' instance d2278934-664f-48c4-be2a-35f1cfa1844a while it is in vm_state rescued {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:27:49.325219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9f6763e7-27f4-4d0e-9972-3c47578fd7d6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments/628a6e1c-80c7-451c-86b6-6bd0f82362a1" status: 409 len: 152 microversion: 2.1 time: 0.099550 Oct 27 13:27:49.325219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 274/532] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:27:49 2022] DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments/628a6e1c-80c7-451c-86b6-6bd0f82362a1 => generated 152 bytes in 101 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 27 13:27:49.331043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:49.331566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:49.337385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.337863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.338292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.338968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.339416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.339834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.409609 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-36579f94-1b4f-43ec-a86a-354518574c35 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/action" status: 202 len: 0 microversion: 2.1 time: 0.082817 Oct 27 13:27:49.410242 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 259/533] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:27:49 2022] POST /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:27:49.418687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:49.419394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:49.425965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.426447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.427076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.427770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:49.428267 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:49.428695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:49.678099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:49.686604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6077d870-ac58-44ad-9b79-a13224f3a65f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1721 microversion: 2.1 time: 0.272074 Oct 27 13:27:49.688497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 275/534] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:49 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:50.714019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:50.715358 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:50.722770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:50.723257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:50.723721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:50.724611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:50.725226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:50.725662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:50.870606 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:50.879998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f0ef9ef3-bc17-4898-a030-3124306b984f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1721 microversion: 2.1 time: 0.171560 Oct 27 13:27:50.881005 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 260/535] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:50 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:51.905581 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:51.906127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:51.912802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:51.913283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:51.913718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:51.914413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:51.914870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:51.915297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:52.045348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:52.053596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a35e13ba-f198-42fa-9927-41cc886c0d29 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1721 microversion: 2.1 time: 0.151964 Oct 27 13:27:52.054147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 276/536] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:51 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:53.076741 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:53.077380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:53.083906 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:53.084435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:53.085406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:53.085578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:53.086027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:53.086447 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:53.232504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:53.241715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ffc1d8f2-17a0-44d5-b25b-6b1a30273b5c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1721 microversion: 2.1 time: 0.168538 Oct 27 13:27:53.242524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 261/537] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:53 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:54.264814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:54.265453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:54.271899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:54.272464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:54.272911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:54.273606 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:54.274060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:54.274488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:54.415514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:27:54.418917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:27:54.426653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3204158e-c4a1-4cb7-89f8-e006532f3778 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1727 microversion: 2.1 time: 0.165452 Oct 27 13:27:54.427209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 277/538] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:27:54 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1727 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:27:54.451792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:27:54.453087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:27:54.459001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:54.459568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:54.460092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:54.460991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:54.461824 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:54.462281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:54.541590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b7016d4e-fa7c-4da0-81a2-6989035002e7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094366 Oct 27 13:27:54.542248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 262/539] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:27:54 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:27:55.433805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:55.451119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:55.451737 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:55.452721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:55.485313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] Creating event network-changed:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:27:55.498553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-75c0d2cb-9463-41f6-a6be-f1e5cd90d63a req-874a2655-5be2-4d37-8200-579cbdbd69b4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069542 Oct 27 13:27:55.499157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 278/540] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:27:57.514742 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:27:57.524039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:27:57.524544 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:27:57.524973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:27:57.536169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] Creating event network-changed:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:27:57.541417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-3067fe93-82ab-40df-b92e-3163d1e71b74 req-1d1eaab2-7c4e-4b32-82db-48607145e824 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030810 Oct 27 13:27:57.542002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 263/541] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:27:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:11.549754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:11.550707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:11.553840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=9 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:11.554486 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:11.560869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:11.561329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:11.561768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:11.562476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:11.562934 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:11.563364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:11.647503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lazy-loading 'services' on Instance uuid ceb3538d-52bc-44df-846e-39f0819fc18a {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:11.728658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-588980f6-2cd5-43b6-8ca2-c2a693db94d1 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a/os-volume_attachments/5d90f719-065e-43e6-9b4d-5d460514a730" status: 202 len: 0 microversion: 2.1 time: 0.182953 Oct 27 13:28:11.729273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 279/542] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:28:11 2022] DELETE /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a/os-volume_attachments/5d90f719-065e-43e6-9b4d-5d460514a730 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:28:12.853946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=13 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:12.854698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:12.858846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:12.859456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:12.867464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:12.867950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:12.868431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:12.869124 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:12.869588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:12.869997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:12.896041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:12.978089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-13e05e25-92a7-4356-b6cb-282a0c40f9f9 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "DELETE /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 204 len: 0 microversion: 2.1 time: 0.125475 Oct 27 13:28:12.978900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 264/543] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:12 2022] DELETE /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:12.988162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:12.988929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:12.995621 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:12.996104 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:12.996578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:12.997272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:12.997728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:12.998154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:13.125924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:13.133781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-632ace1f-f646-40cd-aeb6-6a2ee33f5ce2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1512 microversion: 2.1 time: 0.150395 Oct 27 13:28:13.134345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 280/544] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:12 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:14.158226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:14.158917 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:14.165346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:14.165819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:14.166244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:14.166924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:14.167387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:14.167790 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:14.295846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:14.304326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4e729186-f854-4e42-b4f5-22c3bea2051a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1512 microversion: 2.1 time: 0.150298 Oct 27 13:28:14.304883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 265/545] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:14 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1512 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:15.328872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:15.329630 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:15.337418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:15.337995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:15.338525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:15.339339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:15.339812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:15.340480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:15.449025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:15.457526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9c04e6d6-3d8b-4116-82d9-12ab02b39047 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 200 len: 1470 microversion: 2.1 time: 0.132462 Oct 27 13:28:15.458371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 281/546] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:15 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 1470 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:15.460557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ceb3538d-52bc-44df-846e-39f0819fc18a", "name": "network-vif-deleted", "tag": "50c86583-c5f2-4a50-b745-db2d95e82e4d"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:15.472405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:15.473108 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:15.473542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:15.485176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] Creating event network-vif-deleted:50c86583-c5f2-4a50-b745-db2d95e82e4d for instance ceb3538d-52bc-44df-846e-39f0819fc18a on hv-cinder-86243 Oct 27 13:28:15.490184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-ed02c6cc-1244-4e48-ba93-a7834075cede req-34355084-1d97-4362-b23d-d627992a443e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033861 Oct 27 13:28:15.490858 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 266/547] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:16.482347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:16.482880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: ceb3538d-52bc-44df-846e-39f0819fc18a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:16.489320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:16.490000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:16.491093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:16.491791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:16.492268 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:16.492687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:16.505924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] HTTP exception thrown: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Request method failure captured: Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a HTTP/1.1 Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoccL5SS834adyIIeR6qvCYyZwEUKHM2kTl2DIt_yu1wfCzU8cwQfFf-t4PwkMuxmAs7egPtzfkXXxxqsPQqpYFo8TPaJUQgFZ56bMUQ9w6WKfcsp9UA7QiNBJDbKEbgukXUouwVYoZe5iboHqQxwEsiKpIoG-lVZlCW_Repwdf-zLs Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 6ddba1e8bfeb4c8baf308e9b43bf1bee Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:28:16.507549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 6ddba1e8bfeb4c8baf308e9b43bf1bee Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesSnapshotTestJSON-1287409667-project Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: c12f89d30c834651b659ceeaa8a0fd54 Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesSnapshotTestJSON-1287409667-project Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. Oct 27 13:28:16.509155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'ceb3538d-52bc-44df-846e-39f0819fc18a'} Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:28:16.510006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. Oct 27 13:28:16.511445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:16.512653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Returning 404 to user: Instance ceb3538d-52bc-44df-846e-39f0819fc18a could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:28:16.512653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-43bcc72a-3aae-47dd-bf32-ee6e983d990a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a" status: 404 len: 111 microversion: 2.1 time: 0.030635 Oct 27 13:28:16.512653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 282/548] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:16 2022] GET /compute/v2.1/servers/ceb3538d-52bc-44df-846e-39f0819fc18a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:28:24.397375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1491384445", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "networks": [{"uuid": "e0bdb774-31d7-4659-a84f-c1ee72da57b4"}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:24.453403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] validate_networks() for [('e0bdb774-31d7-4659-a84f-c1ee72da57b4', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:28:24.821847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:28:24.822269 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:28:24.822743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:28:24.823151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:28:24.823556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:28:24.834953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:24.835431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:24.835863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:24.837156 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:24.837674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:24.838069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:24.856803 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Getting quotas for project 6ddba1e8bfeb4c8baf308e9b43bf1bee. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:28:24.860967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Getting quotas for user c12f89d30c834651b659ceeaa8a0fd54 and project 6ddba1e8bfeb4c8baf308e9b43bf1bee. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:28:24.873802 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:28:24.876357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:28:24.932184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9c0e2eb4-a0c4-4b25-8920-2e3e3d8d3bd0 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.539938 Oct 27 13:28:24.932895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 267/549] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:28:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:28:24.948984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1e9fe9f9-0ca7-4524-a4e8-20a2d975e015 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:24.949616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1e9fe9f9-0ca7-4524-a4e8-20a2d975e015 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:25.025236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1e9fe9f9-0ca7-4524-a4e8-20a2d975e015 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:25.032738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1e9fe9f9-0ca7-4524-a4e8-20a2d975e015 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1219 microversion: 2.1 time: 0.091623 Oct 27 13:28:25.033309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 283/550] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:24 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:26.059324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:26.060103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:26.067023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.067512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.067933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.068782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.069141 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.069554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.152150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:26.161520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-34070915-01ce-4abb-a104-7c32d254417f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1271 microversion: 2.1 time: 0.108780 Oct 27 13:28:26.162131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 268/551] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:26 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1271 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:26.183566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:26.184188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:26.191736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.192201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.192887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.193601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.194058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.194494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.225605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fb58bf46-1fd0-4bfd-b32b-20cd77e90f15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments/4197f6bc-482d-4f4c-8670-5ccb469cd09c" status: 200 len: 194 microversion: 2.20 time: 0.046593 Oct 27 13:28:26.226211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 284/552] 10.222.0.48 () {60 vars in 1454 bytes} [Thu Oct 27 13:28:26 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments/4197f6bc-482d-4f4c-8670-5ccb469cd09c => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:28:26.297623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:26.298119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:26.304249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.304769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.305310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.305885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.306341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.306763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.453881 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lazy-loading 'services' on Instance uuid 896767c6-1a1e-4729-992a-7d4dfa6b503c {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:26.595754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-deda16ce-2e7b-4c6c-b393-46237e8de457 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments/4197f6bc-482d-4f4c-8670-5ccb469cd09c" status: 202 len: 0 microversion: 2.20 time: 0.297674 Oct 27 13:28:26.595754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 269/553] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Oct 27 13:28:26 2022] DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments/4197f6bc-482d-4f4c-8670-5ccb469cd09c => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:26.605576 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:26.608059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:26.615076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.616276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.617226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.618331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:26.618966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:26.621800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:26.657027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cdc4e8df-38cf-4def-a790-c4a5bf314456 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059300 Oct 27 13:28:26.657916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 285/554] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Oct 27 13:28:26 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:28:27.187823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:27.188595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:27.197423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:27.197968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:27.198824 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:27.199552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:27.200039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:27.200517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:27.360923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:27.374138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-95fed8d3-4071-4cec-a1c3-be51944f3ca6 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.190783 Oct 27 13:28:27.375091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 270/555] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:27 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:27.679435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:27.683818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:27.695990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:27.696884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:27.697652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:27.698910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:27.699968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:27.700758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:27.755609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d5ee1b82-9f6e-4be8-ac62-5ed5c725852b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084329 Oct 27 13:28:27.756742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 286/556] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Oct 27 13:28:27 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:28:28.295084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f4ce0a5c-84d9-45ed-9354-2aa64d6992cc", "tag": "fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:28.307055 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.307647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.308074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.321292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] Creating event network-changed:fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609 for instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc on hv-cinder-86243 Oct 27 13:28:28.326220 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-00a4ccf6-e6df-4360-9a21-4707148951e4 req-08a3d06f-f855-4555-8e71-5d1a93c5991c service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035478 Oct 27 13:28:28.326774 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 271/557] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:28.406288 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:28.406906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.414675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.415352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.416073 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.417305 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.418055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.418753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.667019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:28.675637 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0330b882-a837-4901-85a3-a5e33589bd68 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.273253 Oct 27 13:28:28.676256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 287/558] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:28 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:28.759664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:28.762236 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.769374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.769867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.770350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.771377 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.772158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.772580 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:28.773040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.775036 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.782556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.783042 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.783669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.784416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.784871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.785692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.817872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c237c4d3-5dab-4e0f-a046-c5c208dc445e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050381 Oct 27 13:28:28.818682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 288/559] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Oct 27 13:28:28 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:28.863204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:28.866247 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.873811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.874307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.874747 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.875491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.888256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.888256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.890879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-76b63707-df0e-4b32-b119-0050829cae53 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action" status: 202 len: 0 microversion: 2.1 time: 0.136913 Oct 27 13:28:28.895698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 272/560] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:28:28 2022] POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:28:28.901421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:28.902029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.910375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.910877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.911318 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.912024 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.912517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.912950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.913059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1ed7b0ba-2643-4ff6-ae4a-4eb5a6e3be1c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054083 Oct 27 13:28:28.913639 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 289/561] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:28 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 13:28:28.918927 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:28.919659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:28.925822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.926464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.926836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.927439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:28.927894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:28.928357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:28.947216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:29.028326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-da9106b4-4b12-4947-a5cf-68f4d9233737 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 204 len: 0 microversion: 2.20 time: 0.132384 Oct 27 13:28:29.029106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 273/562] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Oct 27 13:28:28 2022] DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 27 13:28:29.035079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:29.036261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:29.045132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.045628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.046110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.046859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.047341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.047768 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.074638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:29.089815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.099751 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2e538b60-fd24-46bb-bb5c-87808016d949 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1752 microversion: 2.1 time: 0.184355 Oct 27 13:28:29.100462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 290/563] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:28 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1752 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:29.105916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:29.106620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:29.112667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.113279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.113803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.114599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.115065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.115497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.157459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4837a974-9098-48a7-9b1f-351b87b4ae86 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 204 len: 0 microversion: 2.1 time: 0.125661 Oct 27 13:28:29.157459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 274/564] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:29 2022] DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:29.168396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:29.169597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:29.176794 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.177280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.177712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.178709 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.178891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.179402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.263443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.272344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.275292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.276624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3107e6af-8986-4880-92e2-109dc3ba32f4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.175121 Oct 27 13:28:29.277267 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 291/565] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:29 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:29.339118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.343361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=4,nova_cell1:INSERT=5 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:29.348701 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b34df5bf-0fbc-42e3-8bca-3f3386d8ae05 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1671 microversion: 2.1 time: 0.185835 Oct 27 13:28:29.349292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 275/566] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:29 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1671 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:29.699725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:29.700392 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:29.706343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.706827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.707289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.707987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:29.708485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:29.708928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:29.842350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:29.850123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a10d0694-e3be-4056-8024-8ab23a60e373 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.154809 Oct 27 13:28:29.850702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 292/567] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:29 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:30.126491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:30.127115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:30.135334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.135813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.136254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.137015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.137457 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.137869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.286337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:30.294814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-82ceb163-9ed0-40ca-a485-6ff03ad40ac8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1752 microversion: 2.1 time: 0.172160 Oct 27 13:28:30.295401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 276/568] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:30 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:30.302983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:30.303598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:30.310573 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.311588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.311860 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.312386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.312838 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.313256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.374359 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:30.374974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:30.381786 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.382854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.382854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.383448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.384131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.384659 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.462531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:30.471445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:30.473044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:30.474261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-99fb48e9-e5e0-4e55-83e3-d0fa18600e63 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.175263 Oct 27 13:28:30.474860 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 293/569] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:30 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:30.528258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:30.544067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bd3897d2-1371-4f40-862e-793846d3891b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1671 microversion: 2.1 time: 0.173697 Oct 27 13:28:30.544690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 277/570] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:30 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1671 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:30.875069 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:30.875676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:30.885850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.886225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.886662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:30.887378 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:30.887827 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:30.888292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.021933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.029707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6d9dec97-ff1b-4313-8036-c97b79bae39d tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.159150 Oct 27 13:28:31.030309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 294/571] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:30 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:31.318787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:31.319415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:31.325608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.326089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.326517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.327317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.327773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.328190 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.492052 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.500800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7f8a4273-5a8c-471c-894a-1f1e315c9e0e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1752 microversion: 2.1 time: 0.185885 Oct 27 13:28:31.501372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:31.501523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 278/572] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:31 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1752 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:31.502025 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:31.508641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.509144 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.509594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.510315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.510775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.511199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.572295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:31.572890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:31.581369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.581860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.582302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.583020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:31.583533 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:31.583967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:31.678126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.695500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.698881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.701038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-454531bc-6753-43f1-a49e-b6162d57a82a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.203440 Oct 27 13:28:31.701850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 295/573] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:31 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:31.740668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:31.749040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-906e7209-ab9f-4cab-9eee-9b00fda08a14 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1671 microversion: 2.1 time: 0.183910 Oct 27 13:28:31.749620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 279/574] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:31 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1671 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:32.052985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:32.053802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:32.061057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.061546 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.061984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.062693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.063151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.063580 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.083630 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:32.203507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.212317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e9907b85-abb4-4f47-b4ea-b460e9ed16ab tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.163361 Oct 27 13:28:32.212898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 296/575] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:32 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:32.525006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:32.525811 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:32.532084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.532607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.533041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.533726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.534181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.534598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.707999 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.716160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-50738ad3-15d1-45a0-8edf-14d0c2842e3c tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1752 microversion: 2.1 time: 0.195079 Oct 27 13:28:32.716752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 280/576] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:32 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1752 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:32.729337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:32.730902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:32.736897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.737384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.737842 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.738533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.739002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.739422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.774420 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:32.775140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:32.781957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.782581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.783090 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.783810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:32.784357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:32.784787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:32.891595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.899807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.901291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.902488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3d864a64-2d13-48a5-ba84-e77a20801ed2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.177964 Oct 27 13:28:32.903058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 297/577] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:32 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:32.926744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:32.935370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-60574cbc-1161-45b2-ae10-ea2cb69a15ed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1671 microversion: 2.1 time: 0.165930 Oct 27 13:28:32.935949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 281/578] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:32 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1671 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:33.237508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:33.238324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:33.244956 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:33.245449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:33.245891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:33.246602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:33.247079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:33.247491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:33.400772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:33.408448 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-510a50e3-f614-4717-9271-4e358557b2ea tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.174789 Oct 27 13:28:33.409017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 298/579] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:33 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:33.745364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:33.746777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:33.755542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:33.756405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:33.757414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:33.759639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:33.761119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:33.762349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:33.852878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ce0a5c-84d9-45ed-9354-2aa64d6992cc", "name": "network-vif-plugged", "status": "completed", "tag": "fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:33.863789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:33.864043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:33.864465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:33.879442 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] Creating event network-vif-plugged:fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609 for instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc on hv-cinder-86243 Oct 27 13:28:33.887308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-24ee2dde-f05f-4338-a1eb-a9059d78a5ad req-d21b4574-e12b-406b-853f-31345d68577d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038646 Oct 27 13:28:33.888731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 299/580] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:33.966529 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:33.980809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:34.012192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.012735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.013174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.013888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.014344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.014774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.394681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.405500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-adf9808f-959f-42ef-ac2c-335587d5213e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1752 microversion: 2.1 time: 0.666050 Oct 27 13:28:34.406361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 282/581] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:33 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1752 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:34.418196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:34.419694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:34.428963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.429839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.431009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.431982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.432598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.433352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.482054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.492098 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.494367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.495867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0694a8ca-b602-4b0c-a922-01588cdf46a7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1723 microversion: 2.20 time: 0.566179 Oct 27 13:28:34.500330 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 300/582] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:33 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1723 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:34.507674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:34.508756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:34.521471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.522273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.522861 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.525108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:34.525570 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:34.526175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:34.753002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.763068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2bc529c1-39de-493d-ada4-4563de03cd40 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1319 microversion: 2.1 time: 0.260905 Oct 27 13:28:34.777001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 301/583] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:34 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:34.799278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:34.807969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-827244ac-3d6d-41b7-af32-55ec6aa46c75 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1671 microversion: 2.1 time: 0.396180 Oct 27 13:28:34.821258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 283/584] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:34 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1671 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:35.142757 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "896767c6-1a1e-4729-992a-7d4dfa6b503c", "name": "network-vif-deleted", "tag": "af0fd1e2-0d30-4347-ac85-c508bcc243ba"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:35.150787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:35.156841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.157341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.158217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.173756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] Creating event network-vif-deleted:af0fd1e2-0d30-4347-ac85-c508bcc243ba for instance 896767c6-1a1e-4729-992a-7d4dfa6b503c on hv-cinder-86243 Oct 27 13:28:35.179474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-2b172fd7-afe3-4755-9af2-e93887f00ffd req-cd92e608-9066-4a91-b598-8048588d42b6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041382 Oct 27 13:28:35.180887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 302/585] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:35.437752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:35.438903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:35.445119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:35.449194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=6 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:35.461637 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.463657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.464324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.465845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.466484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.467065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.532933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:35.534388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:35.542618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.543110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.543559 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.544458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.544911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.545542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.586308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.586628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.587257 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.588102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lazy-loading 'fault' on Instance uuid 896767c6-1a1e-4729-992a-7d4dfa6b503c {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:35.670653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:35.688057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:35.689949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:35.691178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e4e5cd4a-a428-438b-9247-376e550f059b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1371 microversion: 2.20 time: 0.164095 Oct 27 13:28:35.692347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 303/586] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:35 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:35.699317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a91179d4-4294-46cc-b7c1-6aaf60a1ef45", "name": "network-vif-deleted", "tag": "1df93e0f-5e21-4eff-a002-553c25504efd"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:35.723690 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.728655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.729308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.760387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] Creating event network-vif-deleted:1df93e0f-5e21-4eff-a002-553c25504efd for instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 on hv-cinder-86243 Oct 27 13:28:35.784308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-12fc5afd-81ae-4896-a153-c7fa7c852ac0 req-7eed06cc-9ab0-49de-acc1-76c16cab8dfb service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091041 Oct 27 13:28:35.785078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 304/587] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:35.786697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:35.790457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:35.791270 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:35.796154 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9516d419-4f81-431c-baca-138950b54f3d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.364813 Oct 27 13:28:35.800902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 284/588] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:35 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:35.821047 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.821584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.822038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.822774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.823236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.823670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.831172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:35.832310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:35.839029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.840009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.840735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.841955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:35.846857 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:35.847694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:35.949149 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:35.964963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7a5f00f7-9546-44d6-b9ec-65bb771ff87a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1604 microversion: 2.1 time: 0.137791 Oct 27 13:28:35.965990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 285/589] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:35 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1604 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:36.021467 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:36.033333 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d7134315-cf0a-4da5-bfe4-e73ea59d1532 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1507 microversion: 2.1 time: 0.247172 Oct 27 13:28:36.048613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 305/590] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:35 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1507 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:36.057714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "61fef50b-aebb-478f-89c6-f0b9982bf092", "device": "/dev/sdb"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:36.061097 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:36.072762 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.073496 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.073999 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.074817 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.075398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.076179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.554595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9cfbde0e-d34a-4155-8711-19b475635194 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "POST /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.501098 Oct 27 13:28:36.555540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 286/591] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:28:36 2022] POST /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc/os-volume_attachments => generated 194 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:36.721650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:36.722912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:36.730233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.731134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.731721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.732640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.733285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.733855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.780092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.780777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.781350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.781966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lazy-loading 'fault' on Instance uuid 896767c6-1a1e-4729-992a-7d4dfa6b503c {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:36.830737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:36.832419 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:36.837000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:36.845614 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.846442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.847456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.848591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.849284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.849908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.850135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:36.851829 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:36.853197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-630437d8-9420-4e86-81b3-7efc1b6a14f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 200 len: 1371 microversion: 2.20 time: 0.135865 Oct 27 13:28:36.868518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 306/592] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:36 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:28:36.893850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:36.894729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:36.903411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.904526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.905209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.912315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:36.913660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:36.914318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:36.988467 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-346b5e13-3a06-4964-b1dc-c241b0039d5e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/ips" status: 200 len: 149 microversion: 2.1 time: 0.098547 Oct 27 13:28:36.994119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 307/593] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:28:36 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/ips => generated 149 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:37.004767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:37.005844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:37.022681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.024169 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.024859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.030082 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.036524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.037442 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.105032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.105653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.106355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.106978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lazy-loading 'fault' on Instance uuid a91179d4-4294-46cc-b7c1-6aaf60a1ef45 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:37.116500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:37.126427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aef95128-7a3b-44c5-9be2-b364ad04d63e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.301203 Oct 27 13:28:37.127234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 287/594] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:36 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:37.136737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f299ca0-b49f-41a4-aade-10eae68de70a"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:37.139234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:37.145872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.146432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.146926 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.147646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.148100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.148583 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.196969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:37.216788 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-54c5fe44-0919-48f9-ad78-fefb83de2189 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1327 microversion: 2.1 time: 0.224760 Oct 27 13:28:37.224758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 308/595] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:36 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1327 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:37.289712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: POST /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/os-volume_attachments HTTP/1.1 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 74 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:28:37.294650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {"volumeAttachment": {"volumeId": "5f299ca0-b49f-41a4-aade-10eae68de70a"}} Oct 27 13:28:37.296547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'server_id': '28008920-1a00-44c9-9036-ef5c8cde50c2', 'body': {'volumeAttachment': {'volumeId': '5f299ca0-b49f-41a4-aade-10eae68de70a'}}} Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.297592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.299123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 400 to user: Invalid volume: volume 5f299ca0-b49f-41a4-aade-10eae68de70a is already attached to instances: 7e8b8230-922c-4d41-90e1-6b62526afc91 {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d41932ff-e1d0-448c-8349-cf5ddfcc1c8e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.171196 Oct 27 13:28:37.304014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 288/596] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:28:37 2022] POST /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2/os-volume_attachments => generated 174 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:28:37.309401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:37.309901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:37.316501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.316983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.317880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.318928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.319542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.320112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.363680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:37.450641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c2841be7-395d-4c4e-90d3-25b6b9828908 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 204 len: 0 microversion: 2.1 time: 0.145151 Oct 27 13:28:37.450966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 309/597] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:37 2022] DELETE /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:37.459770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:37.460572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:37.466959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.467481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.467907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.468900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.469694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.469865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.613952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:37.622841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-deec6631-6562-4209-9bec-f82e36b16268 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1680 microversion: 2.1 time: 0.166847 Oct 27 13:28:37.623677 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 289/598] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:37 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:37.880585 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:37.881487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:37.888840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.889334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.889774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.890490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:37.890943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:37.891368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:37.906358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c HTTP/1.1 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:28:37.908032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:28:37.909713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '896767c6-1a1e-4729-992a-7d4dfa6b503c'} Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:28:37.910716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:28:37.912184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:28:37.913560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:28:37.913560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9acdf866-bebe-4fec-9d49-b51b360da255 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 404 len: 111 microversion: 2.20 time: 0.033645 Oct 27 13:28:37.913768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 310/599] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:37 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:28:37.918877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a61f5d24-9bd0-4c36-87e2-995d0119fab5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '.version_select at 0x7fb3733a8430>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:37.942132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a61f5d24-9bd0-4c36-87e2-995d0119fab5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285257590" status: 204 len: 0 microversion: 2.20 time: 0.026928 Oct 27 13:28:37.943030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 290/600] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Oct 27 13:28:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1285257590 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 13:28:38.154128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:38.154851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:38.161125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.162370 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.162876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.163681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.164276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.164701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.241004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:38.241728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:38.248547 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.249040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.249626 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.250392 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.250916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.251341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.287197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.287801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.288424 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.288884 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lazy-loading 'fault' on Instance uuid a91179d4-4294-46cc-b7c1-6aaf60a1ef45 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:38.333207 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:38.337595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:38.343502 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-425ebb9d-fc74-49e7-ac96-bdfaa8153551 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 200 len: 1327 microversion: 2.1 time: 0.106373 Oct 27 13:28:38.344766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 291/601] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:38 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 1327 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:38.421546 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:38.432000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5f0f6407-69e0-401e-8cdc-0fefa0dfbaf3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.281885 Oct 27 13:28:38.433451 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 311/602] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:38 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:38.648494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:38.649125 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:38.657633 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.658129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.658578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.659296 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:38.659759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:38.660186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:38.832299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:38.840554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e4f46abe-fda2-47c2-bbb7-5f7b352b2571 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1680 microversion: 2.1 time: 0.196626 Oct 27 13:28:38.841143 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 292/603] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:38 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1680 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:38.991533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-aa5b3140-3230-44f8-81a9-a6433c0b90c7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: .version_select at 0x7fb3734faee0>, body: {"keypair": {"name": "tempest-keypair-1576321005", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9C1rvFea6WMBbo4uTfyOOpljU39GlWljz3tmUBswqiJg6OucsVZWfC/++IpVIfzOiucDu4TTgvcxFoVMXpPj/Obq53PiOy/LXisgrI571fDZ6QMCPunbVg0mFfgOaniA=="}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:39.009598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-aa5b3140-3230-44f8-81a9-a6433c0b90c7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:28:39.013714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-aa5b3140-3230-44f8-81a9-a6433c0b90c7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for user e77228bb97fd40dfa311088f28864637 and project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:28:39.037753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-aa5b3140-3230-44f8-81a9-a6433c0b90c7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052076 Oct 27 13:28:39.038361 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 312/604] 10.222.0.48 () {62 vars in 1200 bytes} [Thu Oct 27 13:28:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 54 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 27 13:28:39.367491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:39.369222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:39.375564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.376187 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.376719 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:39.377636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.378250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.378823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:39.396032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 HTTP/1.1 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:28:39.397911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:28:39.399880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'a91179d4-4294-46cc-b7c1-6aaf60a1ef45'} Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:28:39.400835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:28:39.402129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:39.404126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:28:39.405032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-34831bb0-167f-401e-876d-a786cb895348 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 404 len: 111 microversion: 2.1 time: 0.041601 Oct 27 13:28:39.405934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 293/605] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:39 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:39.415897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d3bfbb55-34b8-486b-81be-599bd6a9d7b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '.version_select at 0x7fb37326a280>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:39.449518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d3bfbb55-34b8-486b-81be-599bd6a9d7b3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-768766039" status: 202 len: 0 microversion: 2.1 time: 0.038472 Oct 27 13:28:39.451217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 313/606] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Oct 27 13:28:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-768766039 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:28:39.462190 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:39.463819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:39.472699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.473193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.473968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:39.474729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.475193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.475656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:39.846250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:39.880163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:39.881550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5137c23b-f9bc-403a-b8ea-e17128fa41bc tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.424196 Oct 27 13:28:39.882257 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:39.894171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 294/607] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:39 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:39.894773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.896789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.898018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:39.899353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:39.900094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:39.900810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:40.118691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:40.128624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8d267add-d60e-4787-9cbb-7886642d7406 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1680 microversion: 2.1 time: 0.252747 Oct 27 13:28:40.142611 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 314/608] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:39 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:40.332092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-df811dca-15b2-456a-b6ee-209d1764ea91 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: .version_select at 0x7fb373704c10>, body: {"keypair": {"name": "tempest-keypair-1238833974", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo2SBuVVGA5hPbY1gdwvP+WjUUMkv3RAuhagTdZjmsdZUHtOJCKzFsHUuQPRssLz5RBlMVVeOJwedj8i9yMj7SyNaw67lQVAaK7afHtL4f/5s3pAdvaCoG3jdNqKIoGeA=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:40.340184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=3,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:40.351995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-df811dca-15b2-456a-b6ee-209d1764ea91 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:28:40.356909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-df811dca-15b2-456a-b6ee-209d1764ea91 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for user 8f0bb483c548429295c02558520c6898 and project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:28:40.382444 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-df811dca-15b2-456a-b6ee-209d1764ea91 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055149 Oct 27 13:28:40.383156 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 295/609] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:28:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:40.915200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:40.917159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:40.923928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:40.935502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:40.936523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:40.937397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:40.938615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:40.939435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:40.940484 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:40.986655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:41.157747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:41.161995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:41.170610 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:41.171590 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:41.172200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:41.173146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:41.173776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:41.174748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:41.197301 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:41.208869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d1fcedf6-fad0-41e8-8c78-38d631f2c88b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.301997 Oct 27 13:28:41.229914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 315/610] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:40 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:41.239069 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28008920-1a00-44c9-9036-ef5c8cde50c2", "name": "network-vif-deleted", "tag": "f942fce4-3fce-4282-9e21-4c881b31394c"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:41.249307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:41.250059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:41.250724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:41.266951 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] Creating event network-vif-deleted:f942fce4-3fce-4282-9e21-4c881b31394c for instance 28008920-1a00-44c9-9036-ef5c8cde50c2 on hv-cinder-86243 Oct 27 13:28:41.275242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-83a5fa35-4b79-435f-8a43-2ba10333718b req-32aa272d-87da-41d6-8990-74fc62ba267a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043214 Oct 27 13:28:41.276876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 316/611] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:41.342001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:41.355281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f6fa60d4-9728-4516-b708-40ff78b18f16 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 200 len: 1612 microversion: 2.1 time: 0.201253 Oct 27 13:28:41.369670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 296/612] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:41 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 1612 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:41.765265 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1473395513", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b9e83d77-9944-451b-8320-56a536076101"}], "security_groups": [{"name": "tempest-securitygroup--571386131"}], "key_name": "tempest-keypair-1576321005", "user_data": "}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:41.907719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] validate_networks() for [('b9e83d77-9944-451b-8320-56a536076101', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:28:42.234983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:42.235569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:42.243676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.245043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.245650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.246629 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.248601 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.249368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.563472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:28:42.564166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:28:42.564631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:28:42.565101 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:28:42.565762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:28:42.571161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:42.576589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.577585 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.578290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.579326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.580041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.580724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.584798 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4293437b-5eea-4200-9f86-c683697e5389 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.353314 Oct 27 13:28:42.597611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 297/613] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:42 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:42.610654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:28:42.610904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:42.611465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:42.621440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Getting quotas for user e77228bb97fd40dfa311088f28864637 and project a14a3cf9df9f4034a8a0109fd3e33816. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:28:42.629148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.629896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.630343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.631073 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:42.631534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:42.631965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:42.636547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:28:42.639719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:28:42.648570 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 HTTP/1.1 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:28:42.650434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:28:42.651834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '28008920-1a00-44c9-9036-ef5c8cde50c2'} Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:28:42.652751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:28:42.654191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:28:42.655474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:28:42.655474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-265dde1a-2136-4940-9cb3-c83d664c3175 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 404 len: 111 microversion: 2.1 time: 0.045721 Oct 27 13:28:42.655474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 298/614] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:42 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:28:42.670258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aaa2692d-acdf-40de-babc-c5747b301f3a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '.version_select at 0x7fb3733a8af0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:42.702189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aaa2692d-acdf-40de-babc-c5747b301f3a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-835323036" status: 202 len: 0 microversion: 2.1 time: 0.038107 Oct 27 13:28:42.708109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 299/615] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Oct 27 13:28:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-835323036 => generated 0 bytes in 47 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:28:42.726185 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-34c24086-7c94-433d-ba41-4d27ddeeb7ed tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.967112 Oct 27 13:28:42.728689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 317/616] 10.222.0.48 () {62 vars in 1188 bytes} [Thu Oct 27 13:28:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 972 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Oct 27 13:28:42.765333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:42.766420 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:42.910541 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:42.932957 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:42.934477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:42.935644 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4ae635ae-e0a8-4d0e-a5bc-1099dc0da666 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1282 microversion: 2.20 time: 0.195444 Oct 27 13:28:42.936223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 300/617] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:42 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1282 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:43.150307 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-573089771", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "424d9785-78b4-4b32-922b-56a7b3492659"}], "security_groups": [{"name": "tempest-securitygroup--2038534882"}], "key_name": "tempest-keypair-1238833974", "user_data": "}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:43.373452 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] validate_networks() for [('424d9785-78b4-4b32-922b-56a7b3492659', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:28:43.630386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:43.631908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:43.642004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:43.642493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:43.642933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:43.643639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:43.644105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:43.644535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:43.846388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:43.856896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ab8f5e42-a22e-42f6-a173-96978090d827 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.241959 Oct 27 13:28:43.857997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 301/618] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:43 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:43.862996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:43.863567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:43.873212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:43.874035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:43.875871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:43.877432 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:43.880172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:43.880753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:43.992628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'services' on Instance uuid d2278934-664f-48c4-be2a-35f1cfa1844a {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:44.068948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:28:44.069719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:28:44.071114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:28:44.071660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:28:44.072171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:28:44.083458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.083970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.084538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.085597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.086580 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.087007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.094985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bb40cbee-6580-43a1-99f9-8f8f329cc93a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments/628a6e1c-80c7-451c-86b6-6bd0f82362a1" status: 202 len: 0 microversion: 2.1 time: 0.235663 Oct 27 13:28:44.096054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 302/619] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:28:43 2022] DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments/628a6e1c-80c7-451c-86b6-6bd0f82362a1 => generated 0 bytes in 237 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:28:44.104487 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.105201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.106628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:28:44.110444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Getting quotas for user 8f0bb483c548429295c02558520c6898 and project 5d1a967f9b62401ba95d65a2747e3ec0. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:28:44.111386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.111877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.112369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.113078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.113535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.114102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.122156 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:28:44.124339 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:28:44.179504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cb3120c4-9171-45ad-a3d8-c52aaa000ba3 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.035169 Oct 27 13:28:44.184189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 318/620] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:28:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 1037 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:28:44.190735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:44.190949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.192496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.200577 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.201009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.201713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.202185 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.202666 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.202970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.203423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:44.205785 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:44.207387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-341c00f3-ab38-46fc-97c6-9377d12c93a5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1334 microversion: 2.20 time: 0.109848 Oct 27 13:28:44.208058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 303/621] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:44 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1334 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:44.215783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.219161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.227903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.228576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.229981 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.230891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.231439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.232100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.281318 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-36ab95cf-2059-45f5-b9b7-ed3b701e564c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071559 Oct 27 13:28:44.282138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 304/622] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:44 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:44.289102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f8ba96dd-1cd0-46e5-a712-fcf561cb7019 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.290018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f8ba96dd-1cd0-46e5-a712-fcf561cb7019 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.318154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lazy-loading 'services' on Instance uuid 7e8b8230-922c-4d41-90e1-6b62526afc91 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:44.369572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f8ba96dd-1cd0-46e5-a712-fcf561cb7019 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:44.382003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f8ba96dd-1cd0-46e5-a712-fcf561cb7019 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1237 microversion: 2.1 time: 0.098093 Oct 27 13:28:44.392642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 305/623] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:44 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1237 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:44.430139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d106b34f-c65d-46e7-b6b7-920a09006862 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments/5f299ca0-b49f-41a4-aade-10eae68de70a" status: 202 len: 0 microversion: 2.1 time: 0.247707 Oct 27 13:28:44.430722 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 319/624] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:28:44 2022] DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments/5f299ca0-b49f-41a4-aade-10eae68de70a => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:28:44.439213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.441675 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.449301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.449769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.450373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.451189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.451759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.452062 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.482846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1c4cfc88-5f16-45ad-9feb-98d650933f62 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047504 Oct 27 13:28:44.483335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 306/625] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:44 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:44.885882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:44.886848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:44.893287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.894145 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.894791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:44.895793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:44.896367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:44.897012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.083475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:45.098003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-10fc899f-dbfc-4f93-9f3a-24fb87da263a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.216585 Oct 27 13:28:45.103885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 320/626] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:44 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:45.234329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:45.236015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:45.248566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.249292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.249806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.250641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.251161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.251853 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.295532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:45.298161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:45.305234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.305801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.306393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.307190 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.307646 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.308076 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.323025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:45.331654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:45.333145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:45.334275 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-36637238-7409-409d-872f-e1e6c0e0678f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1340 microversion: 2.20 time: 0.104113 Oct 27 13:28:45.334841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 307/627] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:45 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1340 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:45.342719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8e282258-9b46-4060-bfcc-a449cecc104f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051387 Oct 27 13:28:45.343286 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 321/628] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:45 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:45.409789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:45.410399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:45.417298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.417888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.418403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.419192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.419676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.420099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.485176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:45.495316 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:45.495672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6e7752a6-85fb-488a-bb59-1e3ac449816f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1233 microversion: 2.1 time: 0.089318 Oct 27 13:28:45.497067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 308/629] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:45 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1233 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:45.497845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:45.507720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.508568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.509005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.509711 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:45.510164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:45.510588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:45.548517 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-abf8b4e0-0911-460f-84eb-fb4c8aa85c5a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056754 Oct 27 13:28:45.549548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 322/630] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:45 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:46.140952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:46.141868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:46.149103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.149593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.150029 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.150737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.151223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.151702 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.359297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:46.363154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:46.369982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.370476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.370914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.371741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.372199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.372664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.385734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:46.397249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ad826b07-58c8-4bce-a547-024be774aca3 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.260928 Oct 27 13:28:46.399092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 309/631] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:46 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:46.404953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:46.406471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:46.414771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.415639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.416356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.417630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.418332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.418978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.421077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e79beded-5920-4b21-95dd-5018f52914b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068285 Oct 27 13:28:46.422520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 323/632] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:46 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:46.531744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:46.532671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:46.545935 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.546717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.547347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.548103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.548593 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.549033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.642137 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:46.645345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:46.655116 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-997c1569-6892-4f44-b5e1-4ff6008af18d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1289 microversion: 2.1 time: 0.127479 Oct 27 13:28:46.655951 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:46.656131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 324/633] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:46 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1289 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:46.658935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:46.661309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7b5a4674-d607-4c1a-afa9-f1b00ce0c377 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.260278 Oct 27 13:28:46.662785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:46.665549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:46.669199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 310/634] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:46 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:46.676532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.677324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.677879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.679685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:46.680491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:46.681256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:46.729373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1b82f55b-95a7-46eb-82fd-01caa48c3810 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071896 Oct 27 13:28:46.730090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 325/635] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:46 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:47.435795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:47.438128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:47.442178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:47.443136 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:47.444868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.445363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.445798 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.446506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.446965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.447389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.449845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.450336 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.450771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.451498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.451962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.452427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.481952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7d2a54e3-dcdd-41e4-a4fc-c02ba725991f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050159 Oct 27 13:28:47.482531 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 311/636] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:47 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:47.623004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:47.631541 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d5e0800f-85bc-495b-906b-7550a1b1ea3f tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.193329 Oct 27 13:28:47.632658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 326/637] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:47 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:47.678021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:47.678622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:47.687026 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.687829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.688532 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.689497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.690129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.690672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.700051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:47.700792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:47.707570 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.708061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.708524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.709225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.709677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.710096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.779392 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:47.790593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-92642057-5c09-46d7-9ba8-bd68a27a5128 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1289 microversion: 2.1 time: 0.116161 Oct 27 13:28:47.791398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 312/638] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:47 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:47.800033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:47.802979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:47.811142 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.811639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.812076 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.812809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:47.813262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:47.813685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:47.817999 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:47.847219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b15fa36b-7b3e-44c0-953a-0d6ada7f24d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054508 Oct 27 13:28:47.847791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 313/639] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:47 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:47.866560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:47.874727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:47.876167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:47.877308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e16f7638-f167-4bc0-9eae-762d61937cb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.183403 Oct 27 13:28:47.877877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 327/640] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:47 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:28:48.495995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:48.498920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:48.510202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.510765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.511373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.512310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.513075 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.513568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.552087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a75191f7-0a0f-4812-9616-0d2f0b975b85 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061736 Oct 27 13:28:48.552697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 314/641] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:48 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:48.656615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:48.657228 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:48.664564 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.665059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.665497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.666202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.666663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.667088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.820115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:48.821227 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:48.826938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.827855 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.828514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.829434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.830131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.830640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.873207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:48.886201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d76ed22f-1415-45d9-a1bd-436b397d2a4a tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1757 microversion: 2.1 time: 0.233090 Oct 27 13:28:48.886940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 328/642] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:48 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:48.893530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:48.897428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:48.905802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.906768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.907495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.908464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.909293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.909873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.938777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:48.949145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0034affb-0248-46af-92bf-cddb403c3652 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1289 microversion: 2.1 time: 0.137362 Oct 27 13:28:48.951943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c7b848d7-8d96-4926-b581-3196dd74f9e3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063936 Oct 27 13:28:48.953066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 329/643] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:48 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:48.959972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:48.960890 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:48.964580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 315/644] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:48 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1289 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:48.969625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.970359 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.971163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:48.971965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:48.972749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:48.972749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.123973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:49.134916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:49.136390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:49.137612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3db54da1-424c-464d-8826-74133aae360f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.183150 Oct 27 13:28:49.138363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 330/645] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:48 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:49.464356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:49.473934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.474530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.474952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.487294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] Creating event network-changed:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:28:49.493104 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-e8993d18-2431-43f5-b72b-d92e4b460f09 req-6e194c47-0c74-45af-adb3-0f1e1f61e548 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032512 Oct 27 13:28:49.501181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 316/646] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:49.565022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:49.567202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:49.573906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.574437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.575223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.580327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.593034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.593497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.639677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-abb5bf77-7315-4da2-b96e-8cf72fef182a tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078645 Oct 27 13:28:49.640448 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 331/647] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:49 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:49.920863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:49.922226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:49.932903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.933521 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.934039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.934873 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.935896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.936467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.966377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:49.968832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:49.980066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.994328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.995196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:49.996157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:49.996973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:49.997671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.055932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6a436835-700f-472b-801e-3ed38c11fb72 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.094028 Oct 27 13:28:50.057218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 332/648] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:49 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91/os-volume_attachments => generated 25 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 13:28:50.073942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.075133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.110236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.115116 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.117900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.120139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.122453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.123117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.171994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:50.331465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.340653 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-57db447b-e57b-4dcb-8650-ce7e621cb607 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1760 microversion: 2.1 time: 0.426504 Oct 27 13:28:50.341235 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 317/649] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:49 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1760 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:50.345900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.346397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.353284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.353779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.354219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.354929 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.355387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.355828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.390553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:50.390706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.400048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d4e8c934-d135-4ac5-9d1e-54e81c310673 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1307 microversion: 2.1 time: 0.341027 Oct 27 13:28:50.400786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 333/650] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:50 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1307 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:50.406020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.406940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.413035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.414650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.415397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.416367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.417208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.417869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.496841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8b4bd290-39b0-42af-ab14-a753e478a159 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 204 len: 0 microversion: 2.1 time: 0.154350 Oct 27 13:28:50.497639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 318/651] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:50 2022] DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:50.506298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.507004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.512943 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.513433 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.513875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.514578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.515039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.515466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.556650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.565159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.566651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.567764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6bae5209-11ad-451d-aaba-7ea52a7a8f0e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.165778 Oct 27 13:28:50.568547 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 334/652] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:50 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:50.650546 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:50.652761 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.654918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.658253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7846552f-1ade-41be-8cf5-21708dc3100c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.156333 Oct 27 13:28:50.658818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 319/653] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:50 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:50.661123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.661615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.662055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.662760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.663249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.663699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.693111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bc4e0283-c0f4-4547-968c-3077b351dced tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044396 Oct 27 13:28:50.693689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 335/654] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:28:50 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 13:28:50.786634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.787128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.793005 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.793493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.793934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.794627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.795086 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.795514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.820160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:50.894078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-83fe1855-b91a-4f53-b406-6c8d6db2fbe7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 204 len: 0 microversion: 2.1 time: 0.110971 Oct 27 13:28:50.894756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 320/655] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:50 2022] DELETE /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:50.903530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:50.904136 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:50.910189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.910663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.911090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:50.911768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:50.912215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:50.912680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.040569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.048111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3cb8658e-1028-4ca6-a422-5d8ea1147175 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.148339 Oct 27 13:28:51.048706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 336/656] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:50 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:51.425929 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:51.426617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:51.433675 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.434155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.434586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.435266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.435713 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.436130 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.550368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.558765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b6e553cd-7de6-4988-a411-d0aa7f888489 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1295 microversion: 2.1 time: 0.138070 Oct 27 13:28:51.559334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 321/657] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:51 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1295 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:51.593235 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:51.593967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:51.600318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.601330 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.601765 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.602463 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.602915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.603340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.683232 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:51.683872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:51.689972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.690464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.690962 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.691698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:51.692157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:51.692728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:51.735224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.743961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.745515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.746763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3712cdae-28ea-463f-8434-f84978a409d7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.157446 Oct 27 13:28:51.747362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 337/658] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:51 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:51.820979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:51.828413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-63699c3b-0c5f-4bc5-ab28-e1b30ffbfb5f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.149612 Oct 27 13:28:51.828973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 322/659] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:51 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:52.072357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:52.072930 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:52.079245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.079727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.080351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.081048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.081502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.081926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.209389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.217862 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4735a641-ed54-4d1f-92e3-c08affa41ebf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.149882 Oct 27 13:28:52.218220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 338/660] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:52 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:52.581503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:52.582133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:52.589005 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.589483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.589940 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.590631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.591082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.591499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.653003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.660640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5ed4e2e2-7f9a-4ace-9561-b5071cae819c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1295 microversion: 2.1 time: 0.083056 Oct 27 13:28:52.661201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 323/661] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:52 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1295 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:52.772930 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:52.773565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:52.779473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.779950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.780416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.781100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.781549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.781966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.851708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:52.852618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:52.858478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.858963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.859397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.860085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:52.860565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:52.860985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:52.911111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.919537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.921031 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.922154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a751fb1c-3af2-425c-bcac-9e013b3d4012 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.153644 Oct 27 13:28:52.922719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 339/662] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:52 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:52.992093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:52.999745 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a2f33b07-ed42-4706-8f65-6e86a4bb246a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.152610 Oct 27 13:28:53.000332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 324/663] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:52 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:53.242093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:53.242750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:53.250195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.250807 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.251275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:53.251992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.252483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.252914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:53.399397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:53.407363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c1c90e97-ecf5-486b-b1ac-5d494c883bf0 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.170244 Oct 27 13:28:53.407937 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 340/664] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:53 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:53.683716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:53.684370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:53.691185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.691678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.692117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:53.692854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.693311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.693735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:53.824776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:53.832297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fe9c1e05-6535-4db9-8d3c-dcf2fa89658d tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.152637 Oct 27 13:28:53.832865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 325/665] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:53 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:53.946881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:53.947489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:53.953311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.953786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.954214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:53.955036 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:53.955492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:53.955916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.025121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:54.025651 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:54.031617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.032104 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.032927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.033272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.033725 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.034150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.084480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:54.093034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:54.094482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:54.095625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e5f616c0-acca-4d76-8fa3-7d4ba5e742fa tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.152704 Oct 27 13:28:54.096169 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 341/666] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:53 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:54.160395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:54.168659 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dae421c0-7843-4968-a727-f108762bc07a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.148215 Oct 27 13:28:54.169221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 326/667] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:54 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:54.433412 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:54.434051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:54.435858 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=4 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:54.436562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=16 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:54.443884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.444509 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.445144 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.446627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.447186 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.447504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.581226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:54.590142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-18133879-2c0c-4faa-8d1f-89cc3f1c3427 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.163235 Oct 27 13:28:54.590721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 342/668] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:54 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:54.855466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:54.856017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:54.857950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=8 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:54.863512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.863997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.864480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.865165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:54.865614 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:54.866035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:54.869958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:54.996530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.004386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d907dc8c-60eb-4837-bc53-2082a5704fed tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.152771 Oct 27 13:28:55.004933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 327/669] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:54 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:55.121894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:55.122513 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:55.128818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.129306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.129743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.130439 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.130894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.131321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.191569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:55.192183 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:55.198296 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.198787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.199220 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.199970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.200385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.200808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.258587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.266787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.268290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.269444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-75c28799-5b14-4a37-ab79-095845241ee7 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.151425 Oct 27 13:28:55.270033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 343/670] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:55 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:55.331792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.339497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-612cfd75-b2ad-4c12-b8e4-d4e446b05e22 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.151812 Oct 27 13:28:55.340061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 328/671] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:55 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:55.614348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:55.614967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:55.621450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.621954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.622373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.623065 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:55.623519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:55.623943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:55.760294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:55.768018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-776d50c0-4e61-40ff-9338-039f1e60ec99 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.157530 Oct 27 13:28:55.768690 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 344/672] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:55 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:56.028544 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:56.029075 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:56.035453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.035940 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.036415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.037114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.037574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.038007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.167405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.174880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3a271f7e-f742-4911-89af-381150f6a1c8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.150336 Oct 27 13:28:56.175438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 329/673] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:56 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:56.294773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:56.295311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:56.301224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.301704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.302137 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.302834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.303294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.303718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.363125 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:56.363734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:56.369647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.370129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.370560 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.371242 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.371691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.372106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.438355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.446609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.448039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.449213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-be912114-9622-4a79-9bda-7ba0b9a6d07d tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.158355 Oct 27 13:28:56.449773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 345/674] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:56 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:56.504386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.511959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6666924c-0e13-496c-a6f2-8e8f711e9115 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.152708 Oct 27 13:28:56.512556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 330/675] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:56 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:56.609644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:56.610195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:56.616179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.616762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.617129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.617831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.618287 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.618717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.701446 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lazy-loading 'services' on Instance uuid f4ce0a5c-84d9-45ed-9354-2aa64d6992cc {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:28:56.770859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e8f1e238-dc02-425d-928e-76ab2fa2c5b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc/os-volume_attachments/61fef50b-aebb-478f-89c6-f0b9982bf092" status: 202 len: 0 microversion: 2.1 time: 0.164887 Oct 27 13:28:56.771437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 346/676] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:28:56 2022] DELETE /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc/os-volume_attachments/61fef50b-aebb-478f-89c6-f0b9982bf092 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:28:56.791325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:56.791930 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:56.794828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=1,nova_api:DELETE=1,nova_api:UPDATE=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:56.798811 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.799306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.799742 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.800501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:56.800910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:56.801338 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:56.929759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:56.937456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9f125e3f-e1b1-466a-a677-41881f441146 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.149942 Oct 27 13:28:56.938025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 331/677] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:56 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:57.199912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:57.200755 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:57.206255 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.206742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.207175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.207866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.208404 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.208834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.338375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:57.348578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7ad7a61b-4e4e-4227-a918-d442a5d8181a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.154213 Oct 27 13:28:57.349143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 347/678] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:57 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:57.474972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:57.476063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:57.482644 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.483122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.483707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.484477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.484932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.485352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.535374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:57.535791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:57.542431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.542914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.543344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.544038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.544514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.544933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.691026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:57.698944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c5cfb3f0-0b6e-4267-a11b-688f7b049b0e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.167792 Oct 27 13:28:57.699726 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 348/679] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:57 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:57.703258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:57.714920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:57.716415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:57.717564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b2ae7afc-30a7-4e09-b7cd-1ef0fe0c37ba tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.246557 Oct 27 13:28:57.718133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 332/680] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:57 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:57.960897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:57.961797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:57.965163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:57.968817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.969292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.969729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.970766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:57.970973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:57.971372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:57.993714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:28:58.248617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:58.259804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-45f94e5d-114c-4d0b-9f37-6c6522827fda tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.302613 Oct 27 13:28:58.261383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 349/681] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:57 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:58.374561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:58.375454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:58.383467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.384195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.384808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:58.385705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.386319 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.386905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:58.721580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:58.724531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:58.725156 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:58.732326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.733106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.733704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:58.734624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.735232 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.735810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:58.739254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-888a524a-15d5-4fb5-bca1-3e64b03b0f1e tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.365171 Oct 27 13:28:58.755040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 333/682] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:58 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:58.765396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:58.766194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:58.776504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.777126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.777666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:58.779419 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:58.780014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:58.780624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.001533 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.018800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.020405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.021523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4b9344bb-03a3-4c17-af3a-e66c7265dac3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.265153 Oct 27 13:28:59.022628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 334/683] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:28:58 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:28:59.027447 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d0cf35-31e0-4656-a049-a6e0951f8e2a", "tag": "b1becc91-f71d-4ee7-b328-ecda74f70712"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:59.036930 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.037896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.038016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.049804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] Creating event network-changed:b1becc91-f71d-4ee7-b328-ecda74f70712 for instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a on hv-cinder-86243 Oct 27 13:28:59.054759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-398fbbcb-c0e0-420f-8685-ce38cb14b3f9 req-a9829f9e-0f48-4bb8-8263-e9872dcf495b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030728 Oct 27 13:28:59.055353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 335/684] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:28:59.060525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:59.061112 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:59.067294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.067779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.068215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.069453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.069909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.070389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.096169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:28:59.178563 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d82ef812-9f7c-4bd2-bd8b-bb5c648428bd tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 204 len: 0 microversion: 2.1 time: 0.121744 Oct 27 13:28:59.179407 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 336/685] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:28:59 2022] DELETE /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:28:59.188030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:59.188754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:59.196298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.196823 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.197260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.197966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.198416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.198866 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.227516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.235466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-18ad43de-8e44-459c-9206-dfba4ca0a914 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1683 microversion: 2.1 time: 0.516768 Oct 27 13:28:59.236202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 350/686] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:58 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1683 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:59.285199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:59.285824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:59.292472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.293182 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.293972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.294945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.295561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.296139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.339276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.346956 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ae25635f-1f7c-45c5-8145-b25a44b6b42b tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1513 microversion: 2.1 time: 0.162998 Oct 27 13:28:59.347522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 337/687] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:59 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1513 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:28:59.646034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.655458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-28f673d5-2c75-4cdb-a158-f66f12f7c5fb tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1687 microversion: 2.1 time: 0.374547 Oct 27 13:28:59.656042 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 351/688] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:59 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1687 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:28:59.767009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:28:59.768198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:28:59.778854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7e8b8230-922c-4d41-90e1-6b62526afc91", "name": "network-vif-deleted", "tag": "6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:28:59.786106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.786422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.787998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.791813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.792310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.793300 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:28:59.793920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:28:59.794491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.800596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:28:59.822590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] Creating event network-vif-deleted:6cd99aa2-cd8f-43a1-a6e0-13a9a2ba065c for instance 7e8b8230-922c-4d41-90e1-6b62526afc91 on hv-cinder-86243 Oct 27 13:28:59.832678 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9ef45215-a38a-4b35-b637-c5123f74550e req-c15f660a-8dfd-4a8e-ac3d-6a3149c03f24 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057256 Oct 27 13:28:59.834589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 352/689] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:28:59.950388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:28:59.960397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8a5d8581-742c-4e04-a590-f25422df95d8 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.196469 Oct 27 13:28:59.963047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 338/690] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:28:59 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:00.049125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:00.050176 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:00.062948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.063735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.064457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.065800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.066271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.068110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.211922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.223619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.225490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.226617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9bba76d6-e660-44de-9ec5-994def2a7a01 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.183180 Oct 27 13:29:00.227223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 353/691] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:00 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:00.259928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:00.260963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:00.268075 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.268686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.269193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.270109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.270723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.271305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.345324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9e7340b8-f26f-4298-b844-f35a1b24e231 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1615 microversion: 2.1 time: 0.089320 Oct 27 13:29:00.345799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 339/692] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:00 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:00.371449 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:00.372059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:00.380612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.381099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.381565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.382266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.382781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.383209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.524120 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.532366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8b40e71d-c804-4d75-b1e6-0e667adac0b5 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1513 microversion: 2.1 time: 0.164591 Oct 27 13:29:00.533141 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 354/693] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:00 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1513 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:00.680555 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:00.681172 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:00.687682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.688488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.688708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.690072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:00.690538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:00.690958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:00.762452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:00.770858 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8c0caee5-6b29-4d87-b4b2-d6a3c3687a71 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1619 microversion: 2.1 time: 0.094959 Oct 27 13:29:00.772846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 340/694] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:00 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1619 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:00.995738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:00.998193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:01.016531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.022847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.023365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.024157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.024760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.025442 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.176733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.184611 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6e02b28f-217c-47a2-9ee8-dbb2dfefb7a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.201264 Oct 27 13:29:01.185178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 355/695] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:00 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:01.253584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:01.254451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:01.262101 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.262631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.263076 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.263782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.264261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.264702 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.370140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:01.370758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:01.398894 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.400414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.401602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.403441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.406749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.407499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.452085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.453031 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.453693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.454507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lazy-loading 'fault' on Instance uuid 7e8b8230-922c-4d41-90e1-6b62526afc91 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:01.514598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.526416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.528073 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.528781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.529631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5fd993d3-065d-4383-817b-823174bf2cb9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.281388 Oct 27 13:29:01.530720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 341/696] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:01 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:01.556586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:01.557363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:01.563795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.564628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.565316 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.566388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.567061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.567720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.569622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-642d25e6-ec04-49cc-b111-1b5424ab5a51 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1332 microversion: 2.1 time: 0.203970 Oct 27 13:29:01.570224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 356/697] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:01 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1332 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:01.801080 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:01.801796 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:01.810450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.810956 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.811392 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.812100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.812576 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.813261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.838935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.845178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:01.846506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.846998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.847427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.848934 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'fault' on Instance uuid d2278934-664f-48c4-be2a-35f1cfa1844a {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:01.849549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bf3ba46b-dbae-47ea-b225-35fe705f657f tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1513 microversion: 2.1 time: 0.296735 Oct 27 13:29:01.850241 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 342/698] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:01 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1513 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:01.873202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2278934-664f-48c4-be2a-35f1cfa1844a", "name": "network-vif-deleted", "tag": "3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:01.884462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:01.884985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:01.885408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:01.898143 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] Creating event network-vif-deleted:3c50f87a-00ba-4a9b-ae1a-4388d6ce9b47 for instance d2278934-664f-48c4-be2a-35f1cfa1844a on hv-cinder-86243 Oct 27 13:29:01.902980 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-794eee29-71c0-4558-9ccb-16e461683333 req-e9ee8939-c9ed-45f9-847f-4b54a2e39050 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033669 Oct 27 13:29:01.903568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 343/699] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:01.908944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:01.916502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-26204ff1-d7bd-46db-b183-7a711c9502cf tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1333 microversion: 2.1 time: 0.120091 Oct 27 13:29:01.917219 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 357/700] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:01 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:02.208340 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:02.209044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:02.215953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.216747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.217335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.218788 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.219316 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.219806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.449308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.458681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c3352832-e929-4df3-a1ca-3177f4164cf6 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.254468 Oct 27 13:29:02.460033 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 344/701] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:02 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:02.558211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:02.558741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:02.565403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.566023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.566462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.567164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.567638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.568059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.597552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:02.598271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:02.604806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.605388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.605900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.606682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.607206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.607697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.646697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.647748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.648820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.649302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lazy-loading 'fault' on Instance uuid 7e8b8230-922c-4d41-90e1-6b62526afc91 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:02.691652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.700072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-45b05e5d-591c-4ebb-8f3e-df8da91d0fdb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 200 len: 1332 microversion: 2.1 time: 0.107131 Oct 27 13:29:02.700696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 345/702] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:02 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:02.722224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.730940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.733337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.733564 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-68fa9a03-27d9-4970-b368-c1a00e91f423 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.179400 Oct 27 13:29:02.734327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 358/703] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:02 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:02.872997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:02.873620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:02.880049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.880594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.881023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.882518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.882979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.883354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "name": "network-vif-plugged", "status": "completed", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:02.883476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.893375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.893913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.894349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.906808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] Creating event network-vif-plugged:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:29:02.911936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-32826bdb-d68e-45b3-af22-b7efd2837f36 req-28f94ab0-33ec-493a-9cff-b06ef4aa124a service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033810 Oct 27 13:29:02.912674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 359/704] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:02.917907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.918403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.918898 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.919355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lazy-loading 'fault' on Instance uuid f4ce0a5c-84d9-45ed-9354-2aa64d6992cc {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:02.939572 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:02.940298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:02.947210 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.947710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.948166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.948902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.949361 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.949786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.964740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:02.972737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-feaa8f37-83f6-4da5-8704-f69e658a29f2 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1309 microversion: 2.1 time: 0.103656 Oct 27 13:29:02.973588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 346/705] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:02 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1309 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:02.990437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:02.991496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:02.991931 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:02.992407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'fault' on Instance uuid d2278934-664f-48c4-be2a-35f1cfa1844a {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:03.036044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:03.044052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6ced67c8-01a2-4946-abe4-66d5fd7ba225 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1333 microversion: 2.1 time: 0.108763 Oct 27 13:29:03.044667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 360/706] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:02 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1333 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:03.548034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:03.548839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:03.555763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.556524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.557036 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.557805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.558385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.558975 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.723079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:03.723916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:03.736366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.736915 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.737454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.738368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.738963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.739491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.759268 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 HTTP/1.1 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:29:03.761196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:29:03.763155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '7e8b8230-922c-4d41-90e1-6b62526afc91'} Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:03.765020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:29:03.766338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:03.768847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:03.768847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a6d722e4-f393-4469-9041-e94d45c5cfbe tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 404 len: 111 microversion: 2.1 time: 0.043757 Oct 27 13:29:03.768847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 361/707] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:03 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:29:03.772041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:03.772835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:03.779398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.779887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.780360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.781072 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.781690 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.781944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.835808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:03.843865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aa33142c-ec35-4a69-acd2-550966b40419 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.365221 Oct 27 13:29:03.844455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 347/708] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:03 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:03.849466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-79e2dcf9-88fe-4228-8e25-32d06d92edde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '.version_select at 0x7fb373412430>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:03.869456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-79e2dcf9-88fe-4228-8e25-32d06d92edde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671385918" status: 202 len: 0 microversion: 2.1 time: 0.023720 Oct 27 13:29:03.870043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 348/709] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Oct 27 13:29:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1671385918 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:29:03.925371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f4ce0a5c-84d9-45ed-9354-2aa64d6992cc", "name": "network-vif-deleted", "tag": "fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:03.926661 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:03.936044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:03.936558 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:03.936784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:03.936981 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:03.938021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:03.939223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5d79da60-c1e0-46e4-94c4-d4f680b6a4d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.170873 Oct 27 13:29:03.939781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 362/710] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:03 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:03.949184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] Creating event network-vif-deleted:fa8e9097-a1b6-4eac-bda4-a4ad5cbe8609 for instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc on hv-cinder-86243 Oct 27 13:29:03.954238 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-0cb352cf-a6ab-4135-b18d-33ce2547cbb5 req-c0f9c80f-8a71-412c-a221-1b313fa44a09 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033040 Oct 27 13:29:03.954839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 349/711] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:03.996987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:03.997944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:04.005416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.005995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.007217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.007966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.008457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.008895 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.055139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.055779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.056437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.056901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lazy-loading 'fault' on Instance uuid f4ce0a5c-84d9-45ed-9354-2aa64d6992cc {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:04.069208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:04.071039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:04.078375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.079015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.079674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.080455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.081629 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.081925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.109080 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:04.119589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.120071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.120363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8dd74588-e206-4399-903c-6ab6aed6b2a8 tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1309 microversion: 2.1 time: 0.126924 Oct 27 13:29:04.120979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.121402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 363/712] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:03 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1309 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:04.121567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'fault' on Instance uuid d2278934-664f-48c4-be2a-35f1cfa1844a {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:04.193586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:04.201936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9aad33e6-9d99-445d-ba3f-b843cec74911 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 200 len: 1333 microversion: 2.1 time: 0.137735 Oct 27 13:29:04.202971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 350/713] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:04 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 1333 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:04.632634 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-096ec8ed-a51d-4ca1-8484-02b00db780e8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: .version_select at 0x7fb373298dc0>, body: {"keypair": {"name": "tempest-keypair-614828720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJjgmujl5ITPVazmtdWaCKB4fteelRef1tn3CMYASCkZI10FJUpUUgW9Qp9+xi+HPUg4eXxQb4roDGmW31g3lDKE76/dzr3xDz5YLFmYyDYfdJFYxHYjWrZtTOKNahZxJQ=="}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:04.651383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-096ec8ed-a51d-4ca1-8484-02b00db780e8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:29:04.655694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-096ec8ed-a51d-4ca1-8484-02b00db780e8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:29:04.679714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-096ec8ed-a51d-4ca1-8484-02b00db780e8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051315 Oct 27 13:29:04.680356 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 364/714] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:29:04 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:04.870208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:04.871146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:04.882469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.883905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.885215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:04.886550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:04.887497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:04.888569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.069590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:05.070321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:05.082027 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.082522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.082968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.083687 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.084223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.084772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.112394 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:05.121628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ea1dcdc9-29e0-479f-a9b5-f322175dcaef tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.258014 Oct 27 13:29:05.122667 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 351/715] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:04 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:05.143900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:05.144711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:05.151557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.152383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.153151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.153950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.154483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.155078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.196658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.197270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.197814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.198477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lazy-loading 'fault' on Instance uuid f4ce0a5c-84d9-45ed-9354-2aa64d6992cc {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:05.269875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c12f89d30c834651b659ceeaa8a0fd54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ddba1e8bfeb4c8baf308e9b43bf1bee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:05.280408 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-05da2ad0-2619-404b-8907-04c8fdc956fe tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 200 len: 1309 microversion: 2.1 time: 0.140061 Oct 27 13:29:05.281105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 352/716] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:05 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 1309 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:05.314026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:05.327293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:05.329718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:05.331716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c0c0eb8c-9820-466c-adbc-79ead2bb5cbe tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1407 microversion: 2.20 time: 0.361048 Oct 27 13:29:05.334559 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 365/717] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:04 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1407 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:05.381148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:05.382399 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: d2278934-664f-48c4-be2a-35f1cfa1844a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:05.388689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.389184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.389622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.390426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:05.390881 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:05.394090 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:05.408306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] HTTP exception thrown: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Request method failure captured: Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a HTTP/1.1 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZ1xAtUYrOex98HvjYZlXP0lCdqcKA9lU9x9gpDqxomiQllgjNl3CeHtaWElMpZyLhkIVdMNzfyGu3XpYubic1m1__Hlyxu7bbBlLyrigpCJI1GH_ZSqLd8fYGv4HrHQV_w1OhNa5mBqN3L2RrEvavlCQcpysTSqHq8jqovhh8dDCQ Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:29:05.409989 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 97d696ea0031417d8a1a0b8471c26579 Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. Oct 27 13:29:05.411322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'd2278934-664f-48c4-be2a-35f1cfa1844a'} Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:05.412044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. Oct 27 13:29:05.413362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:05.415178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Returning 404 to user: Instance d2278934-664f-48c4-be2a-35f1cfa1844a could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:05.416045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-92403d24-e2d8-4994-9b15-a7a044a2510e tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a" status: 404 len: 111 microversion: 2.1 time: 0.133928 Oct 27 13:29:05.416628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 353/718] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:05 2022] GET /compute/v2.1/servers/d2278934-664f-48c4-be2a-35f1cfa1844a => generated 111 bytes in 135 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:29:05.428906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3868d5b2-ac7f-4eee-a708-14df41c3580b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '.version_select at 0x7fb373278c10>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:05.450663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3868d5b2-ac7f-4eee-a708-14df41c3580b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-29583311" status: 202 len: 0 microversion: 2.1 time: 0.029063 Oct 27 13:29:05.451671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 366/719] 10.222.0.48 () {58 vars in 1215 bytes} [Thu Oct 27 13:29:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-29583311 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:29:06.145315 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:06.146155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:06.155927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.156458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.156897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.157850 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.158103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.158527 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.303814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:06.304471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] [instance: f4ce0a5c-84d9-45ed-9354-2aa64d6992cc] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:06.310515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.311086 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.311437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.312133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.312608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.313033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.327428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] HTTP exception thrown: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Request method failure captured: Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc HTTP/1.1 Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoccL5SS834adyIIeR6qvCYyZwEUKHM2kTl2DIt_yu1wfCzU8cwQfFf-t4PwkMuxmAs7egPtzfkXXxxqsPQqpYFo8TPaJUQgFZ56bMUQ9w6WKfcsp9UA7QiNBJDbKEbgukXUouwVYoZe5iboHqQxwEsiKpIoG-lVZlCW_Repwdf-zLs Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 6ddba1e8bfeb4c8baf308e9b43bf1bee Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:29:06.329290 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_6ddba1e8bfeb4c8baf308e9b43bf1bee"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 6ddba1e8bfeb4c8baf308e9b43bf1bee Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1287409667 Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesSnapshotTestJSON-1287409667-project Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: c12f89d30c834651b659ceeaa8a0fd54 Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesSnapshotTestJSON-1287409667-project Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. Oct 27 13:29:06.331961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'f4ce0a5c-84d9-45ed-9354-2aa64d6992cc'} Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:06.332764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. Oct 27 13:29:06.334745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:06.337704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] Returning 404 to user: Instance f4ce0a5c-84d9-45ed-9354-2aa64d6992cc could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:06.337704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fe93ee51-3d0f-434f-a768-42f23bc1898a tempest-VolumesSnapshotTestJSON-1287409667 tempest-VolumesSnapshotTestJSON-1287409667-project] 10.222.0.48 "GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc" status: 404 len: 111 microversion: 2.1 time: 0.031586 Oct 27 13:29:06.337704 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 367/720] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:06 2022] GET /compute/v2.1/servers/f4ce0a5c-84d9-45ed-9354-2aa64d6992cc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:29:06.361294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:06.363152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:06.390946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.390946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.390946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.390946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.392107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.393787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.479497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:06.491916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-92bc48e1-8a6c-4d91-94d4-4a7303686dad tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.350602 Oct 27 13:29:06.493085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 354/721] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:06 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:06.560695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:06.574564 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:06.578338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:06.581226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7df36c70-df6c-4ae3-afbf-933f9cc39b89 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1599 microversion: 2.20 time: 0.225604 Oct 27 13:29:06.582316 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 368/722] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:06 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1599 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:29:06.622435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:06.623830 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:06.641215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.641718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.642155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.643021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.643504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.644004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.769041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-acc61353-337f-4e0c-a4af-5d92ce6e5cfb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.163555 Oct 27 13:29:06.770000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 355/723] 10.222.0.48 () {60 vars in 1316 bytes} [Thu Oct 27 13:29:06 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-interface => generated 285 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 27 13:29:06.798300 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-545160512", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4880e921-0c48-45fa-a974-af272c815db4"}], "security_groups": [{"name": "tempest-securitygroup--1765414271"}], "key_name": "tempest-keypair-614828720", "user_data": "}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:06.913648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0cf35-31e0-4656-a049-a6e0951f8e2a", "name": "network-vif-plugged", "status": "completed", "tag": "b1becc91-f71d-4ee7-b328-ecda74f70712"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:06.927434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:06.928946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:06.929629 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:06.943211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] Creating event network-vif-plugged:b1becc91-f71d-4ee7-b328-ecda74f70712 for instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a on hv-cinder-86243 Oct 27 13:29:06.949222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-8c1ec118-ec40-4b09-901f-a48eba3c3a64 req-0343aa84-79c3-4f59-b347-0a035f96daf0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040531 Oct 27 13:29:06.949836 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 356/724] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:06.978699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] validate_networks() for [('4880e921-0c48-45fa-a974-af272c815db4', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:29:07.516830 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:07.517721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:07.525018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:07.525500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:07.525936 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:07.526747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:07.527201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:07.527623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:07.682548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:07.690736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b3a94317-f07b-464c-8a9a-c6ff1a73e067 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1363 microversion: 2.1 time: 0.178606 Oct 27 13:29:07.691341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 357/725] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:07 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:08.014263 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:29:08.014872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:29:08.015645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:29:08.015645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:29:08.015903 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:29:08.025474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.025968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.026406 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.027144 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.027778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.028434 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.045415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:29:08.050121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:29:08.061447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:29:08.063773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:29:08.118021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6bf11ffe-0e62-4b4e-9430-7ea1335c0039 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.324423 Oct 27 13:29:08.118563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 369/726] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:29:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 1326 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:29:08.130491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-84b77f8b-9eaa-410a-8562-5a07adb6bf92 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:08.131645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-84b77f8b-9eaa-410a-8562-5a07adb6bf92 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:08.195122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-84b77f8b-9eaa-410a-8562-5a07adb6bf92 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:08.202348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-84b77f8b-9eaa-410a-8562-5a07adb6bf92 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1240 microversion: 2.1 time: 0.075946 Oct 27 13:29:08.203208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 358/727] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:08 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1240 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:08.404280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:08.416103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.416863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.417514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.422237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:08.430543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] Creating event network-changed:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:29:08.436485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-1b373ead-0bba-4344-b2a4-08755954d9b1 req-850aac5c-79d5-45b6-86ad-52cc6df74251 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036751 Oct 27 13:29:08.437806 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 370/728] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:08.713961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:08.714571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:08.721453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.721940 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.722373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.723069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.723608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.724179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.867489 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:08.875237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e584268a-8470-4e7c-a1c9-50282cb39c36 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1548 microversion: 2.1 time: 0.164990 Oct 27 13:29:08.875748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 359/729] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:08 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1548 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:08.898742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:08.899326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:08.905453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.905940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.906377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.907079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:08.907743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:08.908171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:08.987789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-dcb489cb-f663-4596-879b-ed1c321e94dd tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093258 Oct 27 13:29:08.988432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 371/730] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:29:08 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:08.993907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:08.994673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:09.001718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.002153 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.002597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.003451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.003907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.004354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.035346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:29:09.116503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3b475cf2-a569-4a3f-a52d-7bb5152ed9e6 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 204 len: 0 microversion: 2.1 time: 0.126373 Oct 27 13:29:09.117096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 360/731] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:29:08 2022] DELETE /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:29:09.125145 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:09.125824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:09.133353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.133842 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.134276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.134973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.135425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.135853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.228456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:09.229281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:09.239264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.240056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.240883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.241789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:09.242425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:09.243069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:09.272212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:09.279127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:09.289336 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-023907b4-0bce-4180-b85d-f68a280a2397 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1507 microversion: 2.1 time: 0.168022 Oct 27 13:29:09.290163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 372/732] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:09 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:09.350818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:09.359082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-de5f2e5a-17e6-4179-9549-04341c1d1c7b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1244 microversion: 2.1 time: 0.135575 Oct 27 13:29:09.372794 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 361/733] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:09 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1244 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:10.260410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99d0cf35-31e0-4656-a049-a6e0951f8e2a", "tag": "b1becc91-f71d-4ee7-b328-ecda74f70712"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:10.270474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:10.270954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:10.271383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:10.283576 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] Creating event network-changed:b1becc91-f71d-4ee7-b328-ecda74f70712 for instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a on hv-cinder-86243 Oct 27 13:29:10.289189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-665335f7-9b9b-4c85-9903-5886cc628f94 req-43b5f11c-ff34-43d8-84aa-5c7ad26c715e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032427 Oct 27 13:29:10.289801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 373/734] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:10.317187 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:10.317809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:10.324462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:10.324969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:10.325383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:10.326118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:10.326571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:10.326995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:10.383921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:10.384816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:10.391297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:10.392117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:10.392713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:10.393532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:10.394110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:10.395736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:10.472075 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:10.475753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:10.481777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ab43dc44-913f-4dc3-8b9a-1d6f9e1788c0 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1244 microversion: 2.1 time: 0.102371 Oct 27 13:29:10.482505 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 374/735] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:10 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1244 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:10.483509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-24676352-26c8-4afe-b4f8-fbe0f41c84b4 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1507 microversion: 2.1 time: 0.170178 Oct 27 13:29:10.496645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 362/736] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:10 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1507 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:11.505221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:11.506522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:11.506864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:11.507632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:11.513324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:11.513813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:11.514133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:11.514252 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:11.514618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:11.514958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:11.515095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:11.515557 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:11.516009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:11.516119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:11.516445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:11.516867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:11.580617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:11.588335 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bcdccbf3-a68a-4d4c-9634-6a916a6180d2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1244 microversion: 2.1 time: 0.087441 Oct 27 13:29:11.600486 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 375/737] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:11 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1244 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:11.649307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:11.656985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8e6f9d79-24ea-4f7e-be1c-ee3f0dc8229f tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1507 microversion: 2.1 time: 0.155004 Oct 27 13:29:11.657556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 363/738] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:11 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:12.610838 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:12.611669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:12.617954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:12.618356 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:12.618817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:12.619475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:12.620768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:12.620768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:12.680566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:12.681177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:12.684250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:12.687600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:12.688123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:12.688800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:12.689534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:12.689984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:12.690395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:12.692707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-deabf820-c9bb-4d13-8492-369e5512c4a2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1244 microversion: 2.1 time: 0.085605 Oct 27 13:29:12.693798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 376/739] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:12 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1244 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:12.830374 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:12.838132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6f05e3ed-9e81-457a-bbfd-c9b9404e0356 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1507 microversion: 2.1 time: 0.161586 Oct 27 13:29:12.838717 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 364/740] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:12 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1507 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:13.716196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:13.717041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:13.725221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:13.725993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:13.726958 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:13.728049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:13.728652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:13.729178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:13.841831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:13.862015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:13.863350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:13.869944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f2b4b9e0-99b9-480f-93f7-dc18547c1efc tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1236 microversion: 2.1 time: 0.157222 Oct 27 13:29:13.875571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 377/741] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:13 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1236 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:13.891278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:13.892205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:13.893025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:13.902500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:13.903321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:13.905554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:14.181737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:14.190615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f3ac087e-d267-441d-a5e2-a3d9394b41b7 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1507 microversion: 2.1 time: 0.333101 Oct 27 13:29:14.192317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 365/742] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:13 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1507 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:14.398764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f7d6c5-b670-4c5c-a8b2-87019f4b20f1", "name": "network-vif-deleted", "tag": "9d6eda8e-42f9-41c1-9452-42995d1ecd56"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:14.409955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:14.410965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:14.412220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:14.425714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] Creating event network-vif-deleted:9d6eda8e-42f9-41c1-9452-42995d1ecd56 for instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 on hv-cinder-86243 Oct 27 13:29:14.431127 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-8a7a130b-8b29-4792-bad6-899d009f7636 req-a861a75f-cb92-4f4a-a4f9-007be191a0b3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036764 Oct 27 13:29:14.431868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 378/743] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:14.897540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:14.898157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:14.904658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:14.905152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:14.905589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:14.906291 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:14.906739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:14.907353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:14.972965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:14.982189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d090521d-efc9-41b5-b649-c8af9c89dc50 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1298 microversion: 2.1 time: 0.089209 Oct 27 13:29:14.982924 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 366/744] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:14 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1298 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:15.215853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:15.216495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:15.223753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:15.224296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:15.224778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:15.225453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:15.226010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:15.226431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:15.260035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:15.260554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:15.260984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:15.261797 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lazy-loading 'fault' on Instance uuid 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:15.352636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:15.361232 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7f5c906e-a484-484b-88e4-b602d001d622 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 200 len: 1311 microversion: 2.1 time: 0.149584 Oct 27 13:29:15.361813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 379/745] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:15 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 1311 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:16.006569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:16.007311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:16.013729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.014206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.014642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.015329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.015773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.016189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.149237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:16.157008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-abedee6d-8e4c-4782-bde4-0fa082a9fcb4 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.155181 Oct 27 13:29:16.157565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 367/746] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:16 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:16.385677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:16.386294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:16.389735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:16.393665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.394166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.394610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.395319 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.395811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.396879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.411834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] HTTP exception thrown: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Request method failure captured: Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 HTTP/1.1 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1xAtUYrOex98HvjYZlXP0lCdqcKA9lU9x9gpDqxomiQllgjNl3CeHtaWElMpZyLhkIVdMNzfyGu3XpYubic1m1__Hlyxu7bbBlLyrigpCJI1GH_ZSqLd8fYGv4HrHQV_w1OhNa5mBqN3L2RrEvavlCQcpysTSqHq8jqovhh8dDCQ Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:29:16.413554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 97d696ea0031417d8a1a0b8471c26579 Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. Oct 27 13:29:16.415121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '83f7d6c5-b670-4c5c-a8b2-87019f4b20f1'} Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:16.416020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. Oct 27 13:29:16.417524 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:16.418739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Returning 404 to user: Instance 83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:16.418739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-399c85e3-e05d-42e9-b73e-2966ad1cbf45 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1" status: 404 len: 111 microversion: 2.1 time: 0.033211 Oct 27 13:29:16.418739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 380/747] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:16 2022] GET /compute/v2.1/servers/83f7d6c5-b670-4c5c-a8b2-87019f4b20f1 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:29:16.423642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:16.424157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:16.430261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.430736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.431164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.431843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.432310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.432727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.457419 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:29:16.519734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:16.536710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-568752b6-2dea-46ba-99db-2ee47763c9f8 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 204 len: 0 microversion: 2.1 time: 0.116507 Oct 27 13:29:16.537234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 368/748] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:29:16 2022] DELETE /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:29:16.545212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:16.545859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:16.552815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.553303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.553741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.554446 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:16.554908 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:16.555331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:16.762808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:16.771230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-32fbd5ae-d7ba-413a-a804-ba6cf17e05af tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.229616 Oct 27 13:29:16.771920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 381/749] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:16 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:17.179526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:17.180369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:17.186813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:17.187397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:17.187842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:17.188581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:17.189036 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:17.189465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:17.295853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11301098-003d-44b8-8e75-36876f5a5a37", "tag": "9f2d6467-0202-4c8f-bf74-02393e8d0777"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:17.306653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:17.307418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:17.308064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:17.327000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:17.336079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-38d88106-f1dd-47c5-be41-214c8fd4eb30 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.160605 Oct 27 13:29:17.336744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 369/750] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:17 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:17.350192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] Creating event network-changed:9f2d6467-0202-4c8f-bf74-02393e8d0777 for instance 11301098-003d-44b8-8e75-36876f5a5a37 on hv-cinder-86243 Oct 27 13:29:17.355672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-faff6d95-4bc4-45fc-8485-621929d6ff7e req-3087a81a-97f8-4f4d-82a0-7f8b0d013fd5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063641 Oct 27 13:29:17.356294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 382/751] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:17.794594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:17.795202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:17.801169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:17.801643 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:17.802070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:17.802749 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:17.803195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:17.803609 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:17.931298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:17.939417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-51081c20-0841-40b4-992d-37a475e21b89 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.148660 Oct 27 13:29:17.939974 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 370/752] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:17 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:18.356658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:18.357527 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=10 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:18.362972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:18.363710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:18.370950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:18.371440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:18.371881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:18.372619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:18.373080 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:18.373512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:18.501782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:18.510060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-512aed36-b2eb-4544-8538-69a0c338da48 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.154820 Oct 27 13:29:18.510622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 383/753] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:18 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:18.962593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:18.963198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:18.965465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:18.970709 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:18.971192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:18.971622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:18.972335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:18.972783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:18.973199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:19.106286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:19.113994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-842e4efb-6149-49c3-b255-bc80f893cf44 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.155249 Oct 27 13:29:19.115181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 371/754] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:18 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:19.540566 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:19.541173 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:19.547571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:19.548051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:19.548542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:19.549386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:19.550115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:19.550688 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:19.707066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:19.707066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9a7b0184-ffb6-4722-9858-02bbd402666c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.170606 Oct 27 13:29:19.707686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 384/755] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:19 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:20.138148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:20.138773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:20.145414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:20.145950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:20.146386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:20.147085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:20.147536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:20.147955 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:20.284646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:20.292339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fbc98260-042a-4fbe-bd8b-d6d209ab9a05 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.158061 Oct 27 13:29:20.292910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 372/756] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:20 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:20.731197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:20.731850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:20.738170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:20.738656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:20.739118 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:20.739805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:20.740278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:20.740708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:20.876949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:20.885809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fd56c621-bb32-410f-b29e-c523ff3bc704 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.158854 Oct 27 13:29:20.886385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 385/757] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:20 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:21.316604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:21.317928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:21.325158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:21.325647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:21.326091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:21.327564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:21.327564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:21.327564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:21.472678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:21.480954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e35b8c29-1167-472f-b156-153858be764b tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.168457 Oct 27 13:29:21.481526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 373/758] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:21 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:21.909975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:21.910697 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:21.917562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:21.918052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:21.918515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:21.919238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:21.919718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:21.920139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:22.185210 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:22.194599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-dcf0b862-33f9-4820-bf20-a07196d0053d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.288569 Oct 27 13:29:22.195197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 386/759] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:21 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:22.505631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:22.506388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:22.513500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:22.513987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:22.514413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:22.515290 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:22.515733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:22.516153 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:22.662282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:22.670431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f6355918-5e9e-475d-aa1b-86edfea7c07c tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1521 microversion: 2.1 time: 0.169578 Oct 27 13:29:22.671080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 374/760] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:22 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:23.160695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2", "name": "network-vif-deleted", "tag": "d002aeca-8ed9-4dcb-a918-f911694d6cb8"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:23.170184 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:23.170665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:23.171099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:23.182430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] Creating event network-vif-deleted:d002aeca-8ed9-4dcb-a918-f911694d6cb8 for instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 on hv-cinder-86243 Oct 27 13:29:23.187508 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-44b077e8-79ee-4b0e-a983-8e4fa3464f22 req-7f41814a-a92d-49ab-994f-5654c2ca7b14 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086637 Oct 27 13:29:23.188293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 387/761] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:23.220488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:23.221142 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:23.227390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:23.227881 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:23.228824 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:23.229481 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:23.230012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:23.230504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:23.379348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:23.389509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b7b5ab43-b98b-4460-92b8-0fa35247b446 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.172813 Oct 27 13:29:23.390111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 375/762] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:23 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:23.694640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:23.695208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:23.701387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:23.701874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:23.702310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:23.703004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:23.703458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:23.703880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:23.768560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '97d696ea0031417d8a1a0b8471c26579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a58f7c57ef7f4a54999d16d765d80cc2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:23.776443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9d06ff21-91cb-4c90-8de0-f9c796e6877d tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 200 len: 1479 microversion: 2.1 time: 0.086087 Oct 27 13:29:23.777018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 388/763] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:23 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 1479 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:24.416766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:24.417478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:24.424391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:24.424950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:24.425475 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:24.426255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:24.426747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:24.427176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:24.446620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:24.603483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:24.616619 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1fadabfc-a794-4168-8060-a2eae9a4065c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.207859 Oct 27 13:29:24.621403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 376/764] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:24 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:24.799924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:24.800652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] [instance: 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:24.807703 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:24.808195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:24.808674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:24.809376 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:24.809832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:24.810261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:24.824719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] HTTP exception thrown: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Request method failure captured: Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 HTTP/1.1 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1xAtUYrOex98HvjYZlXP0lCdqcKA9lU9x9gpDqxomiQllgjNl3CeHtaWElMpZyLhkIVdMNzfyGu3XpYubic1m1__Hlyxu7bbBlLyrigpCJI1GH_ZSqLd8fYGv4HrHQV_w1OhNa5mBqN3L2RrEvavlCQcpysTSqHq8jqovhh8dDCQ Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:29:24.826308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a58f7c57ef7f4a54999d16d765d80cc2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a58f7c57ef7f4a54999d16d765d80cc2 Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-5346455 Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 97d696ea0031417d8a1a0b8471c26579 Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-ServerRescueNegativeTestJSON-5346455-project Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. Oct 27 13:29:24.827839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2'} Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:24.829110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. Oct 27 13:29:24.830571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:29:24.831839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] Returning 404 to user: Instance 8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:24.831839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c360bfc2-2888-4a88-a200-8ed1a8421b10 tempest-ServerRescueNegativeTestJSON-5346455 tempest-ServerRescueNegativeTestJSON-5346455-project] 10.222.0.48 "GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2" status: 404 len: 111 microversion: 2.1 time: 0.031724 Oct 27 13:29:24.831839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 389/765] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:24 2022] GET /compute/v2.1/servers/8208bc56-1f0c-4dad-bcdc-2f289d1e1fc2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:29:25.645757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:25.646459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:25.652863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:25.653344 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:25.653777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:25.654469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:25.654915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:25.655333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:25.880923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:25.889193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5607b70e-3893-4002-8e0e-132ef379089d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.247428 Oct 27 13:29:25.890371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 377/766] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:25 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:26.912780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:26.913443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:26.931040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:26.931748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:26.932476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:26.941447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:26.942518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:26.942918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:27.150434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11301098-003d-44b8-8e75-36876f5a5a37", "name": "network-vif-plugged", "status": "completed", "tag": "9f2d6467-0202-4c8f-bf74-02393e8d0777"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:27.164097 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:27.164820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:27.165252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:27.181525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] Creating event network-vif-plugged:9f2d6467-0202-4c8f-bf74-02393e8d0777 for instance 11301098-003d-44b8-8e75-36876f5a5a37 on hv-cinder-86243 Oct 27 13:29:27.187330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-56dc85eb-ed2f-4fda-b067-2946387d3a4e req-7a6d47a2-1cc7-4a75-8528-34d6ae0dbbb6 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041899 Oct 27 13:29:27.188368 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 378/767] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:27.289640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:27.353546 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c2fb9fef-7d58-422e-852a-6594f8946372 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.444894 Oct 27 13:29:27.354416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 390/768] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:26 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:28.385044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:28.386259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:28.398308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:28.399263 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:28.400056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:28.401293 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:28.402105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:28.402828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:28.579890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:28.588807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4cb1652c-cffa-4755-bc18-b2750ffc90b1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1366 microversion: 2.1 time: 0.214501 Oct 27 13:29:28.589487 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 379/769] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:28 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:29.612792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:29.614699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:29.623946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:29.624841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:29.625496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:29.626587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:29.627503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:29.628039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:29.649618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:29.778486 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:29.787672 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c59fff2f-ff1d-4883-a60c-3fbfbd71feb1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1557 microversion: 2.1 time: 0.178882 Oct 27 13:29:29.788521 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 391/770] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:29 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1557 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:29:29.811218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:29.811847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:29.818994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:29.819491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:29.820129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:29.820894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:29.821349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:29.821970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:29.952893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5fdd3c66-2bf0-4b6c-9f86-54179e2dafa7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.145563 Oct 27 13:29:29.953749 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 380/771] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:29:29 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-interface => generated 285 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:31.064130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11301098-003d-44b8-8e75-36876f5a5a37", "tag": "9f2d6467-0202-4c8f-bf74-02393e8d0777"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:31.076677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:31.077302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:31.077968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:31.246017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] Creating event network-changed:9f2d6467-0202-4c8f-bf74-02393e8d0777 for instance 11301098-003d-44b8-8e75-36876f5a5a37 on hv-cinder-86243 Oct 27 13:29:31.252934 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9f01b70e-4bb9-44fd-a549-84cf1349c258 req-cee8d1e2-fff1-4750-91d6-c743e3ae1db9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.192020 Oct 27 13:29:31.253535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 392/772] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:44.572325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:44.573755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=20 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:44.578361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:44.578984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:44.587363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:44.587952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:44.588531 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:44.589414 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:44.589879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:44.590474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:44.622618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d7687845-f056-4c81-ac04-710cf1844be8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/ips" status: 200 len: 152 microversion: 2.20 time: 0.052016 Oct 27 13:29:44.623205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 381/773] 10.222.0.48 () {60 vars in 1289 bytes} [Thu Oct 27 13:29:44 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/ips => generated 152 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:29:46.519409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=24 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:46.520152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=4 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:46.524708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:46.525313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:46.532898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:46.533408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:46.533846 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:46.535224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:46.535744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:46.536207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:46.560416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-976a8309-1692-4ba0-9820-7ab24efacc17 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/ips" status: 200 len: 144 microversion: 2.1 time: 0.043910 Oct 27 13:29:46.561220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 393/774] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:29:46 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/ips => generated 144 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:47.123474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:47.124378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:47.131624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.132110 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.132724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:47.133459 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.133905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.134321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:47.161854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lazy-loading 'flavor' on Instance uuid f232f466-e821-48fe-926c-feadcec39c31 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:47.364846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7e0098f2-faa5-4690-8e6d-5e335b30df65 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/action" status: 202 len: 0 microversion: 2.20 time: 0.246397 Oct 27 13:29:47.365689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 382/775] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Oct 27 13:29:47 2022] POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/action => generated 0 bytes in 248 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:29:47.374179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:47.374867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:47.382407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.382901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.383372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:47.384088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.384604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.385050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:47.558149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:47.567561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:47.569029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:47.570214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3aa24a04-9284-4635-8b09-7f8413eb0ba6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.200334 Oct 27 13:29:47.570800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 394/776] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:47 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:47.942212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dc029925-50de-4866-9474-4c5243bb0951"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:47.944596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:47.950661 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.951152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.951578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:47.952281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:47.952732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:47.953148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:48.234965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-25aeeeb2-d4b3-48ac-8ba9-7af274bf51a2 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297506 Oct 27 13:29:48.235627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 383/777] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:29:47 2022] POST /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 194 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:48.598926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:48.599537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:48.605863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:48.606350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:48.606782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:48.607476 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:48.607930 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:48.608398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:48.745731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:48.754823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:48.756281 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:48.757491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-08ccd610-6657-4c62-88bc-13efc9daf728 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.163041 Oct 27 13:29:48.758017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 395/778] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:48 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:49.783856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:49.784680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:49.790958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:49.791439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:49.791871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:49.792604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:49.793050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:49.793466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:49.929308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:49.937745 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:49.939171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:49.940372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-028c1c73-de89-434e-8869-02772a4e07b1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.161142 Oct 27 13:29:49.940917 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 384/779] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:49 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:50.965538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:50.966151 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:50.972762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:50.973949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:50.974409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:50.975196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:50.975685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:50.976115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:51.160275 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:51.168638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:51.170105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:51.171308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5509eb26-5912-4c7c-a6be-79dc0014d6ae tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.209736 Oct 27 13:29:51.171871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 396/780] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:50 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:52.197205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:52.197808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:52.204244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:52.204739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:52.205164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:52.205859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:52.206305 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:52.206722 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:52.363693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:52.373720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:52.375204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:52.376927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1f15a758-13ef-4b33-93f3-b5834c526a24 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.183334 Oct 27 13:29:52.377698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 385/781] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:52 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:29:53.402510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:53.403123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:53.410087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:53.410571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:53.411128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:53.411843 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:53.412453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:53.412889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:53.549119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:53.558662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:53.562372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:53.563953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9d340a5a-dffa-42e1-8a7a-73df8cadc61b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.165196 Oct 27 13:29:53.564637 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 397/782] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:53 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:53.767861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1874299280"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:53.768498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:53.774863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:53.775349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:53.775779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:53.776506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:53.776954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:53.777370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:53.911860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.network.security_group_api [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Removing security group 38930577-87d3-47b3-8939-1f9b79da7281 from port 5914531a-8c3d-4f54-ab34-59d0c72ab0a9 Oct 27 13:29:54.242865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-151b0e0f-c237-412a-ae03-2fb94726de1e tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action" status: 202 len: 0 microversion: 2.1 time: 0.478818 Oct 27 13:29:54.246952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 386/783] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:29:53 2022] POST /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/action => generated 0 bytes in 484 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:29:54.457569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:54.492574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:54.493500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:54.494194 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:54.508098 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] Creating event network-changed:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:29:54.514343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-27dcdaa3-3db6-4912-9ccb-67228cbe4f5b req-2a40a30f-71a5-436b-96f6-f29e91afc5f5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.265019 Oct 27 13:29:54.522316 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 398/784] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:54.592165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:54.593210 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:54.600917 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:54.601437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:54.601877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:54.602640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:54.603100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:54.603561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:54.899966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:54.911025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:54.912773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:54.914190 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a7418848-b776-4405-8e3b-abdf2c1e5a2f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.327122 Oct 27 13:29:54.914984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 387/785] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:54 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:29:55.526876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:55.527550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:55.534465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.534964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.535502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.536341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.536836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.537242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.632870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lazy-loading 'services' on Instance uuid 8d05f213-8736-4a0e-ab0a-ed60da153000 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:29:55.726945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-60c40ddc-13ce-434b-99ad-feb97be0bc6d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments/f0306296-f98f-464f-994c-97ca5c819fc6" status: 202 len: 0 microversion: 2.1 time: 0.204392 Oct 27 13:29:55.730820 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 399/786] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:29:55 2022] DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments/f0306296-f98f-464f-994c-97ca5c819fc6 => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:29:55.736098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:55.738715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:55.745466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.746245 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.746893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.747851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.748554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.749150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.802581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ad25f39d-59a3-4894-90b7-227fb5e85115 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.070324 Oct 27 13:29:55.803483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 388/787] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:29:55 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:55.865798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:55.868182 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:55.874663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.875152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.875592 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.876598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.877062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.878026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.909166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fa663762-bdc3-425b-94c7-1e8eb833b7f4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047863 Oct 27 13:29:55.910247 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 400/788] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:29:55 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:55.921843 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:55.922443 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:55.929429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.929920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.930356 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.931089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.931542 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.932175 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.941115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:55.941731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:55.952985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.953474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.953903 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.954606 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:55.955058 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:55.955538 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:55.966066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7f41483a-da89-4592-8748-09729e4717b0 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951" status: 200 len: 194 microversion: 2.1 time: 0.049097 Oct 27 13:29:55.966672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 389/789] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Oct 27 13:29:55 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:56.181115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:56.197889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:56.200284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:56.202935 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5fc847d6-64c8-4f58-819e-ec9996e0e427 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.265658 Oct 27 13:29:56.203594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 401/790] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:55 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:29:56.547763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:56.566804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:56.567919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:56.568931 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:56.588952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] Creating event network-changed:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:29:56.603996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-8b0bc9e8-b291-4939-a153-ae8573ca20a0 req-be86ec9c-5783-41e4-bc9a-d17b8cdbf245 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064892 Oct 27 13:29:56.604523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 390/791] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:29:56.816109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:56.818818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:56.833480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:56.834421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:56.834863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:56.835745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:56.836434 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:56.836867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:56.870914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-80f3d1cf-0d26-43df-a1ec-066087754f61 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058889 Oct 27 13:29:56.871708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 402/792] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:29:56 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:29:56.883758 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:56.884370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:56.893685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:56.895069 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:56.897540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:56.898967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:56.899811 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:56.900557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:56.985511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] HTTP exception thrown: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 is not attached to volume f0306296-f98f-464f-994c-97ca5c819fc6 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Request method failure captured: Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments/f0306296-f98f-464f-994c-97ca5c819fc6 HTTP/1.1 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWob_41XqJW9Uh37QtbsJkdvjE3IkQoqFa6AICjnc23tcEDNcf0uCsN9oVlwcOphJoZXWCqhSV3xcTmtt6ZPYUpF75QISDOlJsE9dN8ZMQWE5SECq1d-5_RWmDzio2w7osHtfEJKwfF3KepJk15v7GQDxn9bwPcBqq2Ws9QxbEL9fawc Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 52552d69672a4677bd52c847cceec247 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:29:56.987971 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52552d69672a4677bd52c847cceec247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52552d69672a4677bd52c847cceec247"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52552d69672a4677bd52c847cceec247"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52552d69672a4677bd52c847cceec247"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 52552d69672a4677bd52c847cceec247 Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-TestMinimumBasicScenario-1543390914-project Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 706ba757aacf4256b1416b5e3bbda714 Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-TestMinimumBasicScenario-1543390914-project Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:29:56.989584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 is not attached to volume f0306296-f98f-464f-994c-97ca5c819fc6 Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'server_id': '8d05f213-8736-4a0e-ab0a-ed60da153000', 'id': 'f0306296-f98f-464f-994c-97ca5c819fc6'} Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f0306296-f98f-464f-994c-97ca5c819fc6. Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:29:56.990495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 is not attached to volume f0306296-f98f-464f-994c-97ca5c819fc6 Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 is not attached to volume f0306296-f98f-464f-994c-97ca5c819fc6 Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:29:56.991900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Returning 404 to user: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 is not attached to volume f0306296-f98f-464f-994c-97ca5c819fc6 {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:29:56.993088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e31ad41e-c2b0-4f5d-9004-634a7a8209da tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments/f0306296-f98f-464f-994c-97ca5c819fc6" status: 404 len: 154 microversion: 2.1 time: 0.110538 Oct 27 13:29:56.993088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 391/793] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:29:56 2022] DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000/os-volume_attachments/f0306296-f98f-464f-994c-97ca5c819fc6 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:29:57.230311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:57.231131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:57.237961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:57.238458 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:57.238906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:57.240013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:57.240613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:57.240976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:57.456869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "224a0be0-3d7f-407d-ba72-540329b03c8c"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:29:57.459255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:57.466260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:57.466761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:57.467199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:57.468220 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:57.468704 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:57.469135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:57.474001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:57.483336 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:57.484965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:57.486382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-46a14454-87e3-4a3f-b2de-ba94cd7c0b0b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.260083 Oct 27 13:29:57.487318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 403/794] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:57 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:29:57.729454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8fadd9ab-00c3-4489-b2f1-8ea1fd9b872b tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "POST /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277127 Oct 27 13:29:57.730092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 392/795] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:29:57 2022] POST /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:29:58.144561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:58.145244 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:58.152259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.152771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.153211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.153983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.154510 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.155006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.184277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:29:58.267773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ebcecba7-4b8a-46a1-9337-6541e87db179 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 204 len: 0 microversion: 2.1 time: 0.127101 Oct 27 13:29:58.268543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 404/796] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:29:58 2022] DELETE /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:29:58.278469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:58.279814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:58.286756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.287107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.287558 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.288314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.288903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.289499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.427289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:58.435238 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-eddd6afa-f370-47db-a568-1f91906e2c75 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1554 microversion: 2.1 time: 0.161451 Oct 27 13:29:58.435884 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 393/797] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:58 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1554 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:58.517644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:58.518884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:58.525210 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.525706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.526142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.526847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:58.527303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:58.527730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:58.676386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:58.684708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:58.686149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:58.687329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ce55967c-37ac-4dd9-b5dc-4daba33413bf tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.174144 Oct 27 13:29:58.687890 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 405/798] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:58 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:29:59.459107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:59.459630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:59.466201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:59.466680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:59.467107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:59.467789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:59.468259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:59.468684 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:59.472726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:29:59.614023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:59.628089 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-22e25b73-48ce-446a-b1a9-ce681edabf8d tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1554 microversion: 2.1 time: 0.172696 Oct 27 13:29:59.628733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 394/799] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:29:59 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:29:59.713886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:29:59.714445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:29:59.721501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:59.721991 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:59.722479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:59.723189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:29:59.723650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:29:59.724078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:29:59.863736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:59.875152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:59.877005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:29:59.878311 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2433a5bd-7bd3-47f4-a6ba-1a0ebe10bbf3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.168520 Oct 27 13:29:59.878885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 406/800] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:29:59 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:00.651568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:00.652180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:00.660914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:00.661405 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:00.661835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:00.662537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:00.662983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:00.663402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:00.746761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '706ba757aacf4256b1416b5e3bbda714', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52552d69672a4677bd52c847cceec247', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:00.765894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-fbf2d4df-ef11-4b5f-aaad-94df6a20c0c0 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 200 len: 1512 microversion: 2.1 time: 0.118031 Oct 27 13:30:00.778171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 395/801] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:00 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 1512 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:00.822799 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d05f213-8736-4a0e-ab0a-ed60da153000", "name": "network-vif-deleted", "tag": "5914531a-8c3d-4f54-ab34-59d0c72ab0a9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:00.835094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:00.835573 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:00.836000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:00.851030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] Creating event network-vif-deleted:5914531a-8c3d-4f54-ab34-59d0c72ab0a9 for instance 8d05f213-8736-4a0e-ab0a-ed60da153000 on hv-cinder-86243 Oct 27 13:30:00.855938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9c2200c5-b150-4d1a-b8a9-b4a1dd16d8de req-6ed55944-d466-4f81-a703-3448ebd679f0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037439 Oct 27 13:30:00.857358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 407/802] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:00.910040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:00.910585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:00.916556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:00.917036 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:00.917469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:00.918229 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:00.918681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:00.919279 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:01.061852 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:01.072115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:01.073580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:01.074763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9057b3cc-6fec-450f-b4cb-267d01c50b6f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.169907 Oct 27 13:30:01.075349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 396/803] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:00 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:01.792421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:01.793739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] [instance: 8d05f213-8736-4a0e-ab0a-ed60da153000] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:01.802978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:01.803483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:01.803936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:01.804721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:01.805180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:01.805616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:01.821017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] HTTP exception thrown: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Request method failure captured: Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 HTTP/1.1 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWob_41XqJW9Uh37QtbsJkdvjE3IkQoqFa6AICjnc23tcEDNcf0uCsN9oVlwcOphJoZXWCqhSV3xcTmtt6ZPYUpF75QISDOlJsE9dN8ZMQWE5SECq1d-5_RWmDzio2w7osHtfEJKwfF3KepJk15v7GQDxn9bwPcBqq2Ws9QxbEL9fawc Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 52552d69672a4677bd52c847cceec247 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:01.822854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/52552d69672a4677bd52c847cceec247"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52552d69672a4677bd52c847cceec247"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/52552d69672a4677bd52c847cceec247"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_52552d69672a4677bd52c847cceec247"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 52552d69672a4677bd52c847cceec247 Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1543390914 Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-TestMinimumBasicScenario-1543390914-project Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 706ba757aacf4256b1416b5e3bbda714 Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-TestMinimumBasicScenario-1543390914-project Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. Oct 27 13:30:01.825426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '8d05f213-8736-4a0e-ab0a-ed60da153000'} Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:01.826304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. Oct 27 13:30:01.827791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:01.829147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Returning 404 to user: Instance 8d05f213-8736-4a0e-ab0a-ed60da153000 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:01.829147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-70e70340-1641-47d6-b108-399914d290c8 tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000" status: 404 len: 111 microversion: 2.1 time: 0.038331 Oct 27 13:30:01.829147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 408/804] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:01 2022] GET /compute/v2.1/servers/8d05f213-8736-4a0e-ab0a-ed60da153000 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:30:01.835682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-da65fd30-588d-40ab-8a4c-91959530033b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] Calling method '.version_select at 0x7fb3733239d0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:01.857994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-da65fd30-588d-40ab-8a4c-91959530033b tempest-TestMinimumBasicScenario-1543390914 tempest-TestMinimumBasicScenario-1543390914-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897010317" status: 202 len: 0 microversion: 2.1 time: 0.025808 Oct 27 13:30:01.859079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 397/805] 10.222.0.48 () {58 vars in 1269 bytes} [Thu Oct 27 13:30:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-897010317 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:30:02.101222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:02.102641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:02.108784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:02.109758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:02.110222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:02.111168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:02.112901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:02.113281 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:02.132941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:02.272940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:02.282100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:02.283892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:02.285305 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-806921d2-dfaa-4477-9bae-fc0d816b5f19 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.188475 Oct 27 13:30:02.285853 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 409/806] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:02 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:03.312698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:03.313312 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:03.321010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:03.321500 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:03.321937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:03.322641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:03.323106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:03.323534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:03.766166 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:03.774425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:03.775874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:03.777081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e8d444ea-b48b-420f-bf73-52b4d6bff417 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.468915 Oct 27 13:30:03.777644 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 398/807] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:03 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:04.802905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:04.803522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:04.811049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:04.811859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:04.812343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:04.813061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:04.813522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:04.813945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.027486 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:05.040261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:05.043096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:05.046791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-16efd2de-5036-49a9-b1c6-23c728de1868 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.246108 Oct 27 13:30:05.068499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 410/808] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:04 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:05.352307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:05.354605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:05.361927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.362422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.362863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.363571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.364035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.364495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.407036 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c9fd7b2a-dc59-45a6-be23-1c4fd15afe5f tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058843 Oct 27 13:30:05.407972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 399/809] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:30:05 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 371 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:05.551375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:05.555137 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:05.562170 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.563077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.563723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.565435 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.566103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.566772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.600631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7a639cd3-5ba7-4926-9f9b-231995c1721c tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951" status: 200 len: 194 microversion: 2.1 time: 0.054809 Oct 27 13:30:05.601503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 411/810] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Oct 27 13:30:05 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:05.612813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:05.613315 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:05.630113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.630113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.630113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.630113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:05.630663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:05.630663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:05.717686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lazy-loading 'services' on Instance uuid 99d0cf35-31e0-4656-a049-a6e0951f8e2a {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:30:05.809811 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d0f03abe-092d-43b0-adf3-01ca38f29f48 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951" status: 202 len: 0 microversion: 2.1 time: 0.201203 Oct 27 13:30:05.813891 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 400/811] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:30:05 2022] DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/dc029925-50de-4866-9474-4c5243bb0951 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:30:06.074132 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:06.074878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:06.083391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:06.083963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:06.084427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:06.085678 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:06.086498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:06.087102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:06.410130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:06.420690 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:06.422162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:06.423451 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-93a43c67-1d7c-4065-aaa2-8411f07b5aa9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.353770 Oct 27 13:30:06.424433 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 412/812] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:06 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:06.950246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:06.950972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:06.957915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:06.958403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:06.958837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:06.959537 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:06.959988 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:06.960443 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:06.991226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4207e32d-212b-4d7a-a6e1-71d8284e1207 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/224a0be0-3d7f-407d-ba72-540329b03c8c" status: 200 len: 194 microversion: 2.1 time: 0.045478 Oct 27 13:30:06.991841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 401/813] 10.222.0.48 () {58 vars in 1413 bytes} [Thu Oct 27 13:30:06 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/224a0be0-3d7f-407d-ba72-540329b03c8c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:07.003567 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:07.004257 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:07.010407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:07.011067 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:07.011593 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:07.012494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:07.013464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:07.013970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:07.100585 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lazy-loading 'services' on Instance uuid 99d0cf35-31e0-4656-a049-a6e0951f8e2a {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:30:07.175835 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b654a25e-dfbb-4f04-b323-8b1a64caa9ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/224a0be0-3d7f-407d-ba72-540329b03c8c" status: 202 len: 0 microversion: 2.1 time: 0.176880 Oct 27 13:30:07.176354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 413/814] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:30:06 2022] DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments/224a0be0-3d7f-407d-ba72-540329b03c8c => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:30:07.450628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:07.451326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:07.461253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:07.461848 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:07.462366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:07.463222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:07.463907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:07.464783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:07.673870 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:07.682893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:07.684515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:07.685810 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-81003fdd-35c7-4106-b7f9-f0910c62b99e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.239683 Oct 27 13:30:07.686482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 402/815] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:07 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:08.460466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:08.463982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:08.471844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.472665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.474021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.474942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.475403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.476012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.516094 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-dd1fbbd7-2011-4a27-9819-4b5acee3b200 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059935 Oct 27 13:30:08.534306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 414/816] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:30:08 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:30:08.683716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:08.686694 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:08.693593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.694406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.695015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.696122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.696761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.697366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.713175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:08.714708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:08.724899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.725491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.726301 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.727256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.727936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.728638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.734181 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d0579e78-7635-4072-b4b6-8655913bb9b9 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054478 Oct 27 13:30:08.735369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 403/817] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:30:08 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:30:08.840184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:08.841026 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:08.850552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.851117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.851812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.853106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:08.853748 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:08.854467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:08.917662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:30:09.030085 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7a6f4933-9ab3-4723-9228-badb394aacd7 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 204 len: 0 microversion: 2.1 time: 0.194541 Oct 27 13:30:09.030976 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 404/818] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:30:08 2022] DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 13:30:09.044947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:09.046000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:09.059691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:09.060198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:09.060671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:09.062151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:09.062623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:09.063059 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:09.170211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:09.188032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:09.194179 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:09.195592 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cb2dfb30-6957-4d8f-b22f-cfa440f9c621 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1745 microversion: 2.20 time: 0.487258 Oct 27 13:30:09.226134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 415/819] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:08 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1745 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:09.315945 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:09.332875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e3a6b0a0-8b19-4d83-8279-9b336ff2e370 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1672 microversion: 2.1 time: 0.296377 Oct 27 13:30:09.333470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 405/820] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:09 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1672 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:10.225074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:10.225692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:10.232632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:10.234357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:10.234357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:10.234760 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:10.235331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:10.236581 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:10.362524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:10.363249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:10.377286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:10.378673 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:10.380380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:10.381938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:10.382814 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:10.384080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:10.418920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:10.431528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:10.433738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:10.434883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-139e848a-bbf0-4458-b5a5-be3203744f21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1745 microversion: 2.20 time: 0.214361 Oct 27 13:30:10.435364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 416/821] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:10 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1745 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:10.589080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:10.599338 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6e63fc40-5ad3-4929-92a3-23f249fcc775 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1672 microversion: 2.1 time: 0.241693 Oct 27 13:30:10.599932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 406/822] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:10 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1672 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:11.461294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:11.463100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:11.472205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:11.475317 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:11.477749 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:11.479145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:11.480080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:11.481025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:11.697224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "name": "network-vif-plugged", "status": "completed", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:11.729298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:11.729691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:11.730421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:11.731304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:11.742223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:11.744194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:11.745869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-12c620f0-077e-492d-a37e-f302b9a50fc1 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.289126 Oct 27 13:30:11.747246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 407/823] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:11 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:11.762385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] Creating event network-vif-plugged:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:30:11.766952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:11.767666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:11.774023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-5b53575c-26fe-4d54-88ba-ac076bfa3aee req-c388fe68-dec8-4c55-8d64-c7942e2fb1c9 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.463043 Oct 27 13:30:11.774277 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:11.774605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:11.775103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:11.775928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:11.776442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:11.776935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:11.777284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 417/824] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:11.949011 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:11.958404 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6a022b22-c074-44b5-a3aa-ea7fb7665b8a tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1672 microversion: 2.1 time: 0.209444 Oct 27 13:30:11.959297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 408/825] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:11 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1672 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:12.781111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:12.782679 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:12.796630 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:12.797369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:12.798601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:12.800948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:12.802092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:12.802780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:12.990787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:12.996195 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:13.038866 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:13.042246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:13.043477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:13.059961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:13.062663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:13.066096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:13.107254 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:13.122202 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:13.123736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:13.138407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:13.143568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-df33919f-0617-45f0-ad3c-7bddc459fbb0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.373531 Oct 27 13:30:13.146832 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 418/826] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:12 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:13.209798 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8f0bb483c548429295c02558520c6898', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5d1a967f9b62401ba95d65a2747e3ec0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:13.223502 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b31a2e68-fde6-48ce-a37f-4071107de648 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 200 len: 1604 microversion: 2.1 time: 0.240188 Oct 27 13:30:13.243769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 409/827] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:12 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 1604 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:13.317792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99d0cf35-31e0-4656-a049-a6e0951f8e2a", "name": "network-vif-deleted", "tag": "b1becc91-f71d-4ee7-b328-ecda74f70712"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:13.343793 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:13.347860 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:13.351224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:13.420861 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] Creating event network-vif-deleted:b1becc91-f71d-4ee7-b328-ecda74f70712 for instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a on hv-cinder-86243 Oct 27 13:30:13.430700 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-8fac71cc-ca23-430a-928f-6f2878f6f6b5 req-485a1f78-8c36-4100-a936-838c1cc96add service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116585 Oct 27 13:30:13.441215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 419/828] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:14.175127 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:14.176415 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:14.183083 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:14.183895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:14.184597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:14.185544 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:14.187207 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:14.190642 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:14.273606 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:14.275041 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:14.283984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:14.292105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:14.293504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:14.296534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:14.306010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:14.306616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:14.333506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a HTTP/1.1 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:14.335206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:14.336936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '99d0cf35-31e0-4656-a049-a6e0951f8e2a'} Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:14.337756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:14.339018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:14.352480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:14.354262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f5176c14-b7cf-42be-87be-f29913347f64 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 404 len: 111 microversion: 2.1 time: 0.084363 Oct 27 13:30:14.355372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 420/829] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:14 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:30:14.363906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5e3c3797-4c40-4942-8a05-0eb3fddbe614 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '.version_select at 0x7fb3732b79d0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:14.398100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5e3c3797-4c40-4942-8a05-0eb3fddbe614 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238833974" status: 202 len: 0 microversion: 2.1 time: 0.038358 Oct 27 13:30:14.399130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 421/830] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Oct 27 13:30:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1238833974 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:30:14.681174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:14.702515 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:14.714204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:14.720883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4dad0969-6f76-4f36-9dd1-5fbbdcbcd89a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.544703 Oct 27 13:30:14.748822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 410/831] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:14 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:15.515669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:15.517357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:15.693887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:15.703355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:15.709519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:15.711840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:15.713083 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:15.716001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:15.775712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:15.779389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:15.818818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=67,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:15.840430 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:15.840938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:15.841386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:15.842119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:15.842587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:15.843020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:15.867333 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0cf5f7ac-b7ec-4d50-b5e6-d0124a5a4e12 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/ips" status: 200 len: 151 microversion: 2.1 time: 0.362686 Oct 27 13:30:15.868315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 422/832] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:30:15 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/ips => generated 151 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:16.216019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:16.231671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:16.233320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:16.239318 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cb187e78-b445-4fcd-bc39-ffc0b3528e21 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.476226 Oct 27 13:30:16.240211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 411/833] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:15 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:17.273292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:17.273885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:17.276582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:17.293239 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:17.293972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:17.294348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:17.295149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:17.295563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:17.295990 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:17.650926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:17.673952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:17.675544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:17.676394 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:17.679194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:17.680778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-caf66f4c-d48f-4bd2-9299-e3c5e53f5d53 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.411303 Oct 27 13:30:17.681912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 423/834] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:17 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:17.695552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:17.710775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:17.715375 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:17.716294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:17.716877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:17.719093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:18.314213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e17074b4-1bf8-463d-8477-b4fb872c0fc5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637891 Oct 27 13:30:18.315232 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 412/835] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:30:17 2022] POST /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments => generated 194 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:18.712455 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:18.713193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:18.722496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:18.725823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:18.727914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:18.729054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:18.729873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:18.730387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:18.949990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:18.951296 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:18.964273 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:18.968752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:18.969551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:18.970742 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:18.971473 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:18.972373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:18.997986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:19.009188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:19.014017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:19.018096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.019122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ce4f1a9b-cdc9-4fce-82f1-0e7751812c27 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.311216 Oct 27 13:30:19.019938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 424/836] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:18 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a HTTP/1.1 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:30:19.021726 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.023064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '99d0cf35-31e0-4656-a049-a6e0951f8e2a'} Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:19.023800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.025039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.027819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:19.029256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-31b51880-1f56-4231-add6-842f6c9a6870 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 404 len: 111 microversion: 2.1 time: 0.084195 Oct 27 13:30:19.034014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 413/837] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:30:18 2022] DELETE /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 111 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:30:19.040215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:19.040901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: 99d0cf35-31e0-4656-a049-a6e0951f8e2a] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:19.048437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:19.049126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:19.049714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:19.050664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:19.051358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:19.051944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:19.075398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a HTTP/1.1 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:19.077986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.079610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '99d0cf35-31e0-4656-a049-a6e0951f8e2a'} Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:19.080526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. Oct 27 13:30:19.081909 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:19.084061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance 99d0cf35-31e0-4656-a049-a6e0951f8e2a could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:19.085086 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a88942db-42da-4942-a781-c87882e391a4 tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a" status: 404 len: 111 microversion: 2.1 time: 0.049452 Oct 27 13:30:19.086312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 425/838] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:19 2022] GET /compute/v2.1/servers/99d0cf35-31e0-4656-a049-a6e0951f8e2a => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:30:20.047530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:20.048835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:20.062847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.063894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.067935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.071905 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.072439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.072888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.345013 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:20.345658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:20.362253 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.363803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.365418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.367325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.368054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.368870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.397668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 HTTP/1.1 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:20.400556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.401995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'a91179d4-4294-46cc-b7c1-6aaf60a1ef45'} Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:20.403095 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.405019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.409042 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:20.409906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:20.412202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5fd4cea5-f9f6-42cd-8f40-d9329a93adce tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 404 len: 111 microversion: 2.1 time: 0.072804 Oct 27 13:30:20.414724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 426/839] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:30:20 2022] DELETE /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:30:20.426061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:20.426473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:20.427577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:20.428614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] [instance: a91179d4-4294-46cc-b7c1-6aaf60a1ef45] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:20.428835 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b5e047f6-2bb8-4ab9-94a2-48a8b0028103 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.386235 Oct 27 13:30:20.448453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 414/840] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:20 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:20.450329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.451238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.451794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.453649 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:20.458943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:20.460084 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:20.487207 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] HTTP exception thrown: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Request method failure captured: Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 HTTP/1.1 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZyRb1mrFQrRp_RKxxxMFY4kGvWekUZR-M2Xi6Jq8UxrSVhGEWfNLOC6H19F2bFvapuOqwVnVUX9_M25viIc1_N5PwdwWmU8D6a0mfaR2xW3HgBMAza20pSR4J-OpvFe45rbdz9yvyd3BMiIosyi-B6o6E0c505-feKsj0SDydmiCY Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:20.490108 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_5d1a967f9b62401ba95d65a2747e3ec0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 5d1a967f9b62401ba95d65a2747e3ec0 Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1876215135 Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 8f0bb483c548429295c02558520c6898 Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeTestJSON-1876215135-project Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.491588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'a91179d4-4294-46cc-b7c1-6aaf60a1ef45'} Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:20.492407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. Oct 27 13:30:20.493614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:20.497329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] Returning 404 to user: Instance a91179d4-4294-46cc-b7c1-6aaf60a1ef45 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:20.498500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-322fe219-54be-4d84-8e6a-c2d8b6a604ac tempest-AttachVolumeTestJSON-1876215135 tempest-AttachVolumeTestJSON-1876215135-project] 10.222.0.48 "GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45" status: 404 len: 111 microversion: 2.1 time: 0.081399 Oct 27 13:30:20.499761 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 427/841] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:20 2022] GET /compute/v2.1/servers/a91179d4-4294-46cc-b7c1-6aaf60a1ef45 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:30:21.457429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:21.458050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:21.479222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:21.479707 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:21.501303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:21.507907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:21.509400 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:21.515452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:22.087071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:22.098952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:22.102702 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:22.105908 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6c33ef6c-e17a-4e35-bace-ec10a9f8baf9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.654886 Oct 27 13:30:22.109090 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 415/842] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:21 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:23.140794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:23.141421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:23.154917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:23.200888 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.046s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:23.213928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:23.216218 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:23.221293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:23.222109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:23.800828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:23.812948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:23.814753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:23.816634 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e6958fa9-2166-4fe6-94e8-3c2d760dece3 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.681150 Oct 27 13:30:23.817373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 428/843] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:23 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:24.851713 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:24.856942 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:24.881831 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:24.904911 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.023s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:24.905376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:24.913259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:24.914016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:24.927960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:25.659700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:25.683417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:25.685411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:25.686807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3ef8e3bb-4da2-4018-a754-c1903e0a75a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.841177 Oct 27 13:30:25.688434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 416/844] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:24 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:25.823809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:25.827385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:25.837921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:25.838679 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:25.839772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:25.841787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:25.842479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:25.843273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.080051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: POST /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments HTTP/1.1 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 74 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:26.083582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {"volumeAttachment": {"volumeId": "15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469"}} Oct 27 13:30:26.086140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'server_id': '11301098-003d-44b8-8e75-36876f5a5a37', 'body': {'volumeAttachment': {'volumeId': '15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469'}}} Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:26.087574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:26.089836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 400 to user: Invalid volume: volume 15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 is already attached to instances: 11301098-003d-44b8-8e75-36876f5a5a37 {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:26.096485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-af71336a-df94-42a9-92e0-9f13abccda17 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.276858 Oct 27 13:30:26.101424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 429/845] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:30:25 2022] POST /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments => generated 174 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:30:26.232746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:26.237403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:26.280355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.281291 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.281969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.283082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.290418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.291214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.537253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lazy-loading 'services' on Instance uuid 11301098-003d-44b8-8e75-36876f5a5a37 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:30:26.715901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:26.716880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:26.718574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9e311306-7217-404f-9450-d2e9d82d2027 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments/15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469" status: 202 len: 0 microversion: 2.1 time: 0.494596 Oct 27 13:30:26.723796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 417/846] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:30:26 2022] DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments/15002b9b-0f2d-4e3e-b1a7-4a2b0efc4469 => generated 0 bytes in 501 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:30:26.744125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.749520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.749821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:26.756375 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.757387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.758015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.758791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:26.759277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.785712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.786214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.786654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.800386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:26.801102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:26.801455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:26.917527 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dfd85ef8-8295-472f-8aac-a1f2d68a2b1c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.183703 Oct 27 13:30:26.918132 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 418/847] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:30:26 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments => generated 197 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:27.284616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:27.294495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:27.324636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:27.330652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:27.333710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-18139398-db43-4bc7-93cc-c828508e48a4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.624031 Oct 27 13:30:27.339923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 430/848] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:26 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:27.931507 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:27.934861 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:27.948985 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:27.951406 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:27.955849 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:27.956851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:27.959683 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:27.960352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.060585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1da7203d-de18-4076-81b8-cc7d30750847 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.130059 Oct 27 13:30:28.067796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 419/849] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:30:27 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37/os-volume_attachments => generated 25 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 27 13:30:28.187881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:28.188948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:28.197838 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.198658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.199101 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.200071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.201130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.202350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.272514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:30:28.380471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:28.381361 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:28.391513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.392210 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.399703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.401586 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.406278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.408200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.523064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-02a8e024-78a3-42a0-af09-a10fbe90c6d8 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 204 len: 0 microversion: 2.1 time: 0.340358 Oct 27 13:30:28.524112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 431/850] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:30:28 2022] DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:30:28.533180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:28.536408 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:28.557302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.557799 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.558230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.558945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:28.559401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:28.559972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:28.772826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:28.794719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bd51aedc-0e81-4610-b447-8dae3bcda272 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1682 microversion: 2.1 time: 0.265872 Oct 27 13:30:28.816309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 432/851] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:28 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1682 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:28.937429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:28.954025 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:28.958435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:28.962790 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6cf54ec3-d8a7-484e-961a-937d3324dc1f tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.587369 Oct 27 13:30:28.971718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 420/852] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:28 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:29.833161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:29.834553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:29.851804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:29.852514 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:29.853099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:29.853987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:29.854763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:29.855383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:29.896345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1020591043", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "networks": [{"uuid": "cf9d9e9d-f4b9-457d-9d91-950e7084e959"}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:30.067777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] validate_networks() for [('cf9d9e9d-f4b9-457d-9d91-950e7084e959', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:30:31.080617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:31.099770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b3d726dd-d7d9-4b74-b98a-214b0313fe54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1682 microversion: 2.1 time: 1.276164 Oct 27 13:30:31.104193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 433/853] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:29 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1682 bytes in 1285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:31.118368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:31.131611 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:31.161635 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:31.188383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:31.191091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:31.192298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:31.193030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:31.195589 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:32.570020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:32.592969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:32.607824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:32.618702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-569b6d6b-df94-46fe-839f-02ff62cb6f35 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 1.504482 Oct 27 13:30:32.620923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 434/854] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:31 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 1516 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:32.644628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:32.653152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:32.687741 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:32.694730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:32.698854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:32.703475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:32.705539 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:32.707962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:33.153467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:30:33.154909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:30:33.155545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:30:33.157057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:30:33.158453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:30:33.187434 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:33.200605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:33.201526 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:33.201817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:33.204690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:33.215015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:33.216362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:33.217522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-78cdfb59-0a95-4a7c-bc6f-e44959157efb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1614 microversion: 2.1 time: 0.590352 Oct 27 13:30:33.218114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 435/855] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:32 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1614 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:33.259108 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Getting quotas for project 9f309e5e9bf84fff939c088e7c256bfb. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:30:33.270243 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Getting quotas for user 261dfac380ce4eb28eb197cd512b6edc and project 9f309e5e9bf84fff939c088e7c256bfb. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:30:33.338540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:30:33.347863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:30:33.528209 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5955113c-21e0-4d44-94fe-198c9d42beac tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.633490 Oct 27 13:30:33.536322 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 421/856] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:30:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 3647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 27 13:30:33.548601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-37b65446-74ab-42d7-8fab-10b8fb21fe7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:33.549628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-37b65446-74ab-42d7-8fab-10b8fb21fe7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:33.651044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:33.652191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:33.665964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:33.669262 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:33.670864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:33.675569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:33.676540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:33.678165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:33.989954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-37b65446-74ab-42d7-8fab-10b8fb21fe7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:34.000107 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-37b65446-74ab-42d7-8fab-10b8fb21fe7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1214 microversion: 2.1 time: 0.458235 Oct 27 13:30:34.007159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 436/857] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:33 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1214 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:34.248811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:34.250093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:34.277747 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:34.301555 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.026s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:34.324922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:34.335922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:34.348471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:34.354727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:34.840197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:34.866689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-05a769cc-0d7c-468d-8757-205d18f4a50e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 200 len: 1614 microversion: 2.1 time: 0.621806 Oct 27 13:30:34.868531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 437/858] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:34 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 1614 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:34.881998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11301098-003d-44b8-8e75-36876f5a5a37", "name": "network-vif-deleted", "tag": "9f2d6467-0202-4c8f-bf74-02393e8d0777"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:34.923369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:34.925650 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:34.927191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:34.989421 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] Creating event network-vif-deleted:9f2d6467-0202-4c8f-bf74-02393e8d0777 for instance 11301098-003d-44b8-8e75-36876f5a5a37 on hv-cinder-86243 Oct 27 13:30:35.005487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-c58b7aec-cec5-487e-bbef-d5b0f9e7866d req-e57d6417-3a23-4a95-b40e-6f6f648387cd service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.134925 Oct 27 13:30:35.011841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 438/859] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:35.030638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:35.031605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:35.051994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:35.053233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:35.053882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:35.055328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:35.055955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:35.057813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:35.219431 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:35.231977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-deb80068-0d6b-4f14-bf50-192acf2c73b5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1210 microversion: 2.1 time: 0.208330 Oct 27 13:30:35.233304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 439/860] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:35 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1210 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:35.354037 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:35.395566 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:35.403997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:35.408135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7a178758-56cd-4f7c-82d1-891ba322d772 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 1.761497 Oct 27 13:30:35.412280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 422/861] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:33 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 1766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:35.902485 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:35.903512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:35.916342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:35.919558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:35.921925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:35.924345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:35.927388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:35.928080 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:35.977554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 HTTP/1.1 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:30:35.986187 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:30:35.987625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '11301098-003d-44b8-8e75-36876f5a5a37'} Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:30:35.988394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:30:35.989619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:30:35.995021 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:30:35.996933 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3b2f0589-dc4d-421b-ada3-6359a8abd997 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 404 len: 111 microversion: 2.1 time: 0.107021 Oct 27 13:30:35.998038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 440/862] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:35 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:30:36.007708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-14483277-f59a-4b68-a701-e2aaf3169aed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '.version_select at 0x7fb376df8310>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:36.072765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-14483277-f59a-4b68-a701-e2aaf3169aed tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-614828720" status: 202 len: 0 microversion: 2.1 time: 0.068537 Oct 27 13:30:36.077941 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 423/863] 10.222.0.48 () {58 vars in 1218 bytes} [Thu Oct 27 13:30:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-614828720 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:30:36.255876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:36.257324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:36.272163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:36.274624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:36.275239 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:36.278502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:36.279221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:36.279988 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:36.459467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:36.465335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:36.485126 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:36.486504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:36.487383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:36.488912 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:36.492021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:36.492021 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:36.749066 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:36.788160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5753273b-5927-4e32-892e-05a8b16d1af0 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1266 microversion: 2.1 time: 0.536303 Oct 27 13:30:36.792539 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 441/864] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:36 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1266 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:37.291467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:37.307173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:37.309211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:37.314964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cddcb00f-7938-49f9-a375-86a1ebc0d723 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.875205 Oct 27 13:30:37.316178 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 424/865] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:36 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 877 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:37.821166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:37.823382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:37.846714 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:37.848748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:37.852808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:37.855730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:37.856313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:37.858082 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:38.346010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:38.347280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:38.367286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:38.368869 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:38.373725 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:38.377043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:38.381868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:38.382641 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:38.713519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:38.735850 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8dda6752-f76a-4309-ae3e-1c292b390b0f tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1272 microversion: 2.1 time: 0.922148 Oct 27 13:30:38.737087 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 442/866] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:37 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1272 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:38.802606 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:38.826339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:38.827888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:38.831914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ae293216-8044-45db-a704-4101954318f0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.493470 Oct 27 13:30:38.837630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 425/867] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:38 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:39.320608 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ef4cd348-91f6-47b1-9661-91a472071a44 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Action: 'create', calling method: .version_select at 0x7fb3732781f0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-936264149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMrbuPIh1mVtYbjLCvkMzAelfMgGj6N4iXlweZZx/eqc7EbngNGTTTJeH4aWsGy8Eu7MNkCwtb/y+ztG5nMsqIech3RJt4XVfPsetwrGgFQu6cuyxPGA5hHGwJQ9VmPrNQ=="}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:39.355056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-ef4cd348-91f6-47b1-9661-91a472071a44 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for project f291a3a8c0394e928aee758baa470ca7. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:30:39.362787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-ef4cd348-91f6-47b1-9661-91a472071a44 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for user a41fc97ca6ea4a1c8201f068b26e6888 and project f291a3a8c0394e928aee758baa470ca7. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:30:39.417833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ef4cd348-91f6-47b1-9661-91a472071a44 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.679357 Oct 27 13:30:39.418474 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 443/868] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:30:38 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:39.640369 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-094e3276-501b-4477-b51b-278cca591d1a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: .version_select at 0x7fb376df8820>, body: {"keypair": {"name": "tempest-keypair-1119592942", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN0NgQt9WlV06RnQ9unZYRY7GcwX3CqpROadRBuvAyuudl0JJhRaHxdSmO60tc+lZfRt4yGKOczRrmA98zsowsKK3TOzZYD4WPo6yP9X1gEibPRPHhALKlmyW5Yo1aGcFA=="}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:39.670615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-094e3276-501b-4477-b51b-278cca591d1a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:30:39.677664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-094e3276-501b-4477-b51b-278cca591d1a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'key_pairs'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:30:39.719327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-094e3276-501b-4477-b51b-278cca591d1a tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.089014 Oct 27 13:30:39.729528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 426/869] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:30:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:39.763191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:39.764077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:39.782597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:39.783366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:39.783957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:39.785730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:39.786365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:39.786984 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:39.867387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:39.868278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:39.877448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:39.881339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:39.881959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:39.882966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:39.883572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:39.884133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:39.933708 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:40.294836 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:40.309502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5e6f195b-fd47-4fb7-9182-eee0539f1440 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.550727 Oct 27 13:30:40.310570 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 444/870] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:39 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:40.502161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:40.540691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:40.554180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:40.558045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2e7c8642-eb52-4e7b-823f-f59c606b799a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1740 microversion: 2.20 time: 0.693493 Oct 27 13:30:40.562944 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 427/871] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:39 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1740 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:41.339096 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:41.340309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:41.351217 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:41.352581 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:41.353698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:41.360181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:41.363128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:41.363802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:41.593953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:41.600735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:41.613458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:41.614437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:41.615243 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:41.616551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:41.617352 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:41.618282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:42.046398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:42.053742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:42.085199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:42.085607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-137bf2db-2929-4510-8240-4c5ea586af9c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.750115 Oct 27 13:30:42.089725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 445/872] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:41 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:42.091114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:42.094878 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c4660db3-70bb-4c79-8946-4875aa251ad8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1722 microversion: 2.20 time: 0.504969 Oct 27 13:30:42.095495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 428/873] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:41 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1722 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:42.484152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60173dcf-6c4d-49f4-a9be-49396bb2013c", "tag": "d1d1a827-63f9-4c8d-8776-78408c57852b"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:42.507878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:42.509397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:42.510100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:42.539026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] Creating event network-changed:d1d1a827-63f9-4c8d-8776-78408c57852b for instance 60173dcf-6c4d-49f4-a9be-49396bb2013c on hv-cinder-86243 Oct 27 13:30:42.550498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9058d46f-f09b-4c42-83b5-bf4793dc2997 req-65af19cf-5bcb-4c1d-b8cb-f1cada41797b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071015 Oct 27 13:30:42.552839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 446/874] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:43.146385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:43.148934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:43.151664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:43.163175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:43.181437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:43.183721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:43.184522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:43.185237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:43.186219 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:43.187064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:43.191113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:43.192136 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:43.192529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:43.193709 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:43.197498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:43.200081 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:43.326078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:43.590841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:43.605844 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:43.607713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:43.609597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4fc154e3-538e-4451-b1c5-4e912725da75 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1722 microversion: 2.20 time: 0.485240 Oct 27 13:30:43.610293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 447/875] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:43 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1722 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:43.680439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:43.691211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-78a1f459-4010-4d89-a541-2c3416d5b1e3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.580404 Oct 27 13:30:43.691789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 429/876] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:43 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:44.078906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1449451467", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4880e921-0c48-45fa-a974-af272c815db4"}], "security_groups": [{"name": "tempest-securitygroup--1699289577"}], "key_name": "tempest-keypair-1119592942", "user_data": "}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:44.232892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] validate_networks() for [('4880e921-0c48-45fa-a974-af272c815db4', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:30:44.639710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:44.640608 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:44.647420 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:44.648116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:44.648541 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:44.649261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:44.657932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:44.658409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:44.844513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:44.857179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:44.872766 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:44.875023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-134a7627-136b-4875-9880-ddd37f7ef9d8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1725 microversion: 2.20 time: 0.239389 Oct 27 13:30:44.884395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 430/877] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:44 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:44.889528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:44.894170 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:44.905579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:44.906067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:44.907806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:44.909214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:44.909847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:44.910436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.096179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:45.110521 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e960f967-1f3d-4cdd-b9bc-89d3f5e736c7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.224754 Oct 27 13:30:45.111114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 431/878] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:44 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:45.117064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "594dd63a-0718-4e50-b957-438fe005d525"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:45.119395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:45.126804 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.127589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.128457 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.129169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.130000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.130987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.162920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:30:45.163523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:30:45.163867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:30:45.164313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:30:45.164791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:30:45.181317 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.181939 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.182089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.189437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.189821 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.190067 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.227416 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:30:45.238224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Getting quotas for user a385ba4ea6ee4a2fa76f0f12719427ee and project 095dae174c664eafaf3ed463d8b7f319. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:30:45.257526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:30:45.260125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:30:45.332430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6a0f6733-ab11-4929-9587-ed18284220dd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.267943 Oct 27 13:30:45.333165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 448/879] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:30:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 1270 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:30:45.346968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-69512b9d-a13a-4b0b-a580-a1e964aae84c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:45.347715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-69512b9d-a13a-4b0b-a580-a1e964aae84c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:45.443625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-69512b9d-a13a-4b0b-a580-a1e964aae84c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:45.453360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-69512b9d-a13a-4b0b-a580-a1e964aae84c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1242 microversion: 2.1 time: 0.112134 Oct 27 13:30:45.456627 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 449/880] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:45 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1242 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:45.543996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "name": "network-vif-unplugged", "status": "completed", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:45.578820 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.579341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.579772 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.601720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.compute.server_external_events [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] Unable to find a host for instance f232f466-e821-48fe-926c-feadcec39c31. Dropping event network-vif-unplugged {{(pid=118773) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 27 13:30:45.603496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-7f0c4847-882e-4d7a-aac5-a08ee67b8888 req-76665ac6-be2c-455e-8ff8-207848e5a884 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.062783 Oct 27 13:30:45.604518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 450/881] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 65 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 27 13:30:45.606525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-10fd9a9b-d437-41a5-babb-86ef83d3071e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.493785 Oct 27 13:30:45.607144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 432/882] 10.222.0.48 () {62 vars in 1364 bytes} [Thu Oct 27 13:30:45 2022] POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments => generated 188 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 27 13:30:45.804088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:45.804920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:45.812996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.813790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.814528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.815642 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:45.816374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:45.817052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:45.948038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:46.147629 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:46.152796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:46.193658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:46.208664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.209265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.213539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.215015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.215735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.216461 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.245728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a7071802-58b2-413f-b129-670797207b1b tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments/594dd63a-0718-4e50-b957-438fe005d525" status: 202 len: 0 microversion: 2.20 time: 0.431930 Oct 27 13:30:46.247584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 451/883] 10.222.0.48 () {60 vars in 1457 bytes} [Thu Oct 27 13:30:45 2022] DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments/594dd63a-0718-4e50-b957-438fe005d525 => generated 0 bytes in 449 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:30:46.392324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:46.392324 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:46.418097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.420038 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.421093 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.421867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.422348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.422790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.514455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:46.525900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f54fcba3-6543-4912-8cd6-092af1c7925a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.394243 Oct 27 13:30:46.527403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 433/884] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:46 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:46.548514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:46.549169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:46.556787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.557616 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.558072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.558806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.559275 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.559715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.563945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118773) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 13:30:46.579623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:46.657177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:46.674950 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5fa9b5d7-817c-4b1c-9e13-d0c231bdd042 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1294 microversion: 2.1 time: 0.146085 Oct 27 13:30:46.680394 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 434/885] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:46 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1294 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:46.707655 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ad852ee4-6797-4e54-abbd-b8ee48e841db tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/action" status: 202 len: 0 microversion: 2.20 time: 0.326448 Oct 27 13:30:46.708306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 452/886] 10.222.0.48 () {62 vars in 1319 bytes} [Thu Oct 27 13:30:46 2022] POST /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/action => generated 0 bytes in 328 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 27 13:30:46.717779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:46.718822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:46.725838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.726442 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.726981 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.727768 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:46.728332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:46.728885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:46.903672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:46.914117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:46.915920 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:46.917281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7b2531fd-d1f6-478f-a9b1-1b9bb9dd7739 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1673 microversion: 2.20 time: 0.204409 Oct 27 13:30:46.918051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 435/887] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:46 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1673 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:47.556972 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:47.558368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:47.567077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.568015 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.568766 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:47.571051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.571941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.572720 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:47.703648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:47.705373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:47.717816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.727237 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.727895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:47.728895 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.729535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.730135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:47.859211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:47.876626 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1019b4dc-b4ce-4012-bebf-0e1838735747 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.324114 Oct 27 13:30:47.877595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 453/888] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:47 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:47.897000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:47.905081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2e3d9d7a-1c63-4a7c-a102-88744940163c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1300 microversion: 2.1 time: 0.209610 Oct 27 13:30:47.905890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 436/889] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:47 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1300 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:47.943659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:47.944313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:47.950770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.951583 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.952193 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:47.953115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:47.953743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:47.954337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:48.243870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:48.254258 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:48.255989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:48.257622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-21bcc9e3-47c0-4e05-9129-d4bac9390247 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.317906 Oct 27 13:30:48.259074 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 454/890] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:47 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:48.900048 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:48.901517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:48.907134 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:48.907621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:48.908057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:48.908795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:48.909251 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:48.909670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:48.929889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:48.930624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:48.944130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:48.945657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:48.946296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:48.947135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:48.947698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:48.948196 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:49.214874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:49.225458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-79ad680a-b4c3-4b00-9768-68980eefdb82 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.329187 Oct 27 13:30:49.226485 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 437/891] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:48 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:49.273869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:49.284937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:49.285558 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:49.285812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d1220092-071a-4529-a870-801cd9040e2b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.360571 Oct 27 13:30:49.286504 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 455/892] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:48 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:49.294783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:49.296002 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:49.296701 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:49.297571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:49.298194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:49.298779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:49.548365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:49.566077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:49.570295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:49.572078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0e50d399-7556-41ba-9ad5-a7274c6456f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.291235 Oct 27 13:30:49.573346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 438/893] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:49 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:30:49.692731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60173dcf-6c4d-49f4-a9be-49396bb2013c", "name": "network-vif-plugged", "status": "completed", "tag": "d1d1a827-63f9-4c8d-8776-78408c57852b"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:49.710061 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:49.711001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:49.711725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:49.727685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] Creating event network-vif-plugged:d1d1a827-63f9-4c8d-8776-78408c57852b for instance 60173dcf-6c4d-49f4-a9be-49396bb2013c on hv-cinder-86243 Oct 27 13:30:49.735466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-3d2a4849-911f-4d64-b23f-5b6854464710 req-a086b5c6-bcdf-43d1-8496-5ae9d258e0e0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050368 Oct 27 13:30:49.736523 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 456/894] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:49.846378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5164aa13-2f80-4ec4-b981-3eafb193fa9d", "tag": "aab2e22a-bc37-4db4-9d43-12304845eb83"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:30:49.863815 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=10 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:49.867278 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:49.868397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:49.869017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:49.892904 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] Creating event network-changed:aab2e22a-bc37-4db4-9d43-12304845eb83 for instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d on hv-cinder-86243 Oct 27 13:30:49.898148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-edadfa26-97fc-49e8-b19a-c828a55d508c req-01aa2d10-f4af-4cfa-8eea-4d102803b099 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059758 Oct 27 13:30:49.898744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 439/895] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:30:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:30:50.250371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:50.250985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:50.257237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.257724 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.258162 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.258855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.259310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.259733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.310425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:50.311648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:50.318276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.318805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.319247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.319952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.320466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.320893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.406085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:50.414002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cb1fd22c-ba59-4e5a-a705-786ecee478cc tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.169146 Oct 27 13:30:50.414588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 457/896] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:50 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:50.459654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:50.467764 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cac2d885-a1c1-4a11-94a1-b2830cb1a49f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.161995 Oct 27 13:30:50.468336 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 440/897] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:50 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:50.599192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:50.599799 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:50.605820 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.606302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.606735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.607430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:50.608422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:50.608851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:50.747556 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:50.758249 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:50.759767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:50.760993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8f01fb4c-b5c9-4393-b54f-ef46f650bc15 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.165710 Oct 27 13:30:50.761553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 458/898] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:50 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:51.437632 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:51.438429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:51.444535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.445016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.445451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.446144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.446595 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.447016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.490825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:51.491898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:51.498461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.498940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.499648 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.500780 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.500939 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.501423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.590571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:51.599745 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b72c3f41-45bc-4cfe-9cf0-778fcf5d39c9 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.166670 Oct 27 13:30:51.600754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 441/899] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:51 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:51.641289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:51.649120 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d01d28f4-df42-4616-ba51-26668711a44b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.162316 Oct 27 13:30:51.649605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 459/900] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:51 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:51.786585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:51.787200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:51.793294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.793776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.794206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.795016 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:51.796122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:51.796572 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:51.801217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:51.937941 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:51.946039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:51.947482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:51.948690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-89c3ce16-d532-400d-81d6-c90831800099 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.166010 Oct 27 13:30:51.949247 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 442/901] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:51 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:52.623622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:52.626054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:52.634337 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:52.634928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:52.635365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:52.636134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:52.636719 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:52.637202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:52.683860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:52.688589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:52.703585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:52.704678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:52.705410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:52.706580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:52.707342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:52.708054 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:52.937956 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:52.987881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d5f5cf0f-1354-47c7-ae06-e3b6de4bb841 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.368300 Oct 27 13:30:52.988790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 460/902] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:52 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:53.019006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:53.021052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:53.041354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:53.042597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:53.043722 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:53.046005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:53.047056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:53.047816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:53.059503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:53.077258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e193272d-e372-4b77-beca-2c9854019920 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.404871 Oct 27 13:30:53.079234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 443/903] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:52 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:53.278977 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:53.295009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:53.296810 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:53.298045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9dde0828-354c-42ef-8b9c-ffb7ca487de5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.305953 Oct 27 13:30:53.298784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 461/904] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:52 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:54.044797 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:54.046239 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:54.072063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.072932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.073670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.074851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.088578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.089486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.108158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:54.109569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:54.118976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.120754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.121794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.123852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.125040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.126516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.306427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:54.307201 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:54.316480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-071f8196-f384-4a86-8ffa-1ae6d4f29046 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.278760 Oct 27 13:30:54.317058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 444/905] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:54 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:54.324366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e478e2ea-a36b-455e-948f-53f322fe3e29 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.220223 Oct 27 13:30:54.325546 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 462/906] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:54 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:54.332731 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:54.333676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:54.341151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.342079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.342796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.343806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:54.344393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:54.345187 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:54.494987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:54.508412 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:54.510009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:54.511692 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-cb648e3e-5e99-427b-80ba-92889698920e tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.190778 Oct 27 13:30:54.512382 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 445/907] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:54 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:55.344327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:55.350834 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:55.351445 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:55.351715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:55.353613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:55.359585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.360033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.360249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.360549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.360851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.360965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.361670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.361769 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.362243 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.362391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.362692 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.362958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.448790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=14 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:55.557357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:55.558103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:55.565526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9d1a5421-7117-4139-94c0-6676924713f5 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.225291 Oct 27 13:30:55.566058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f8338e29-77ac-44ef-8951-2c582ad0e8f3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.219099 Oct 27 13:30:55.566863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 446/909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:55 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:55.566998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 463/909] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:55 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:55.571424 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:55.572245 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:55.578431 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.579113 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.579545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.580327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:55.580777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:55.581196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:55.737321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:55.746140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:55.747752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:55.749377 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-be207e2c-a918-4cd0-aafa-a6218413492a tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.181490 Oct 27 13:30:55.750190 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 447/910] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:55 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:56.589178 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:56.595080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:56.597090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:56.597367 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:56.608817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.609575 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.610175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.610508 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.611205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.611425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.611851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.612211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.612724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.613306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.613526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.613847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.764172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:56.772706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a135eae0-d7d1-4d20-bb8a-4b318aeafef6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.187457 Oct 27 13:30:56.789216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 464/911] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:56 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:56.795472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:56.796364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:56.802870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.803374 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.803817 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.804575 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:56.805030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:56.805461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:56.816159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:56.829753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4ebab08e-7e39-45f6-9ef9-2dd78f14cdb7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.238642 Oct 27 13:30:56.838990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 448/912] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:56 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:56.985553 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:56.993905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:56.995352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:56.996582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-01e6483c-6d00-4a24-ac12-d60d7692ded0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.205993 Oct 27 13:30:56.997152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 465/913] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:56 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:57.800723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:57.802180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:57.809746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:57.810816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:57.811256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:57.812214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:57.812863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:57.813301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:57.854376 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:57.855315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:57.865283 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:57.867019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:57.867808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:57.868950 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:57.869693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:57.870353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:57.902698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:30:58.058993 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:58.072279 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bf1e7227-97b2-4c34-ad14-eec5030fea0c tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.275557 Oct 27 13:30:58.073249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 449/914] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:57 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:58.073822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:58.081701 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:58.082354 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:58.083441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ab6380e8-4f6e-4466-be37-c1eed066c8fd tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.233577 Oct 27 13:30:58.084382 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 466/915] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:57 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:58.089656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:58.090441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:58.091176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:58.092210 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:58.093197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:58.093876 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:58.269020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:58.280965 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:58.282689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:58.284248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-550acff2-14e2-474d-b0e6-9e6cf78b66f8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.206702 Oct 27 13:30:58.284877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 450/916] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:58 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:30:59.099942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:59.100639 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:59.107646 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.108152 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.108636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.109180 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:59.109721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.109816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.110193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:59.110360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.120508 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.121863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.122518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.123467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.124735 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.125605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.337438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:59.352948 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-50c59c5f-5083-4ed2-bc7a-e909595e90c5 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.249054 Oct 27 13:30:59.365756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 451/917] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:59 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:30:59.394004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:59.399930 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:30:59.403730 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:30:59.405912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5426a425-d58c-4211-b2cf-ae5660d86e97 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.309633 Oct 27 13:30:59.406520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 467/918] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:30:59 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:30:59.422022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.424047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.424640 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.425871 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:30:59.428294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:30:59.428294 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:30:59.677715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:59.691482 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:59.693411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:30:59.694693 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-509e9641-763d-4150-836d-91a9926d1409 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.325836 Oct 27 13:30:59.695455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 452/919] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:30:59 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:00.410478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:00.411089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:00.418189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.418991 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.420167 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.420968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.421436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.421873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.446732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:00.447350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:00.456090 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.457040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.457214 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.457949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.458403 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.459290 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.652356 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:00.663328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-eaea19f0-2b03-4548-9fff-0e15dd68aec1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.256990 Oct 27 13:31:00.667234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:00.677173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-be023310-a435-4e6f-9c52-bec2f2dd6cf3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.234520 Oct 27 13:31:00.688642 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 468/920] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:00 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:00.691953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 453/921] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:00 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:00.791948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:00.797859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:00.817582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.818787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.819017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.828859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:00.828859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:00.828859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:00.998005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:01.006667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:01.008304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:01.009409 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e8f30ad9-7d38-4858-8fd8-94eb73a424b6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.282962 Oct 27 13:31:01.009997 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 469/922] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:00 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:01.714901 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:01.716478 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:01.718071 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:01.719981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:01.723310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:01.723807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:01.724257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:01.724996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:01.725454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:01.725916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:01.729117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:01.729631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:01.730086 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:01.730881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:01.731351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:01.731798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:01.878514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:01.887111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9973ac42-420a-4659-9cec-0781b602a987 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.176060 Oct 27 13:31:01.887710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 454/923] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:01 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:01.915534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:01.924383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-df738e8f-e114-414b-89b7-6247bc70317e tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.212684 Oct 27 13:31:01.924970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 470/924] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:01 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:02.035761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:02.036424 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:02.042729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.043224 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.043665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:02.044978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.045441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.045874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:02.186449 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:02.194860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:02.196340 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:02.197556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2ef57540-5826-4672-baa4-33c29807c3ec tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.165830 Oct 27 13:31:02.198117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 455/925] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:02 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:02.909657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:02.910251 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:02.917334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.918082 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.918515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:02.919758 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.920212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.920659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:02.946910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:02.947524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:02.953676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.954163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.954594 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:02.955295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:02.955746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:02.956264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:03.062326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:03.078831 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a77bc9de-6203-4226-b3d9-79e3d4ee154c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.172825 Oct 27 13:31:03.079399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 471/926] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:02 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:03.113379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:03.121552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2ac7f787-8592-4120-bef1-1513513c30f2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.178413 Oct 27 13:31:03.122144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 456/927] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:02 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:03.224644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:03.225165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:03.231673 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:03.232957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:03.233475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:03.234221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:03.234774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:03.235181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:03.372966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:03.382658 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:03.384305 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:03.385391 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2442ed47-e104-41a8-8a8e-74911262cad9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.165049 Oct 27 13:31:03.385960 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 472/928] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:03 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:04.107721 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:04.108398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:04.114666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.115148 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.115580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.116287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.116746 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.117165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.144610 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:04.145238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:04.152032 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.152715 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.153164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.153936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.154417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.154880 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.260639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:04.268737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-32629e42-74b1-45d7-8754-858ae36a7f54 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.165406 Oct 27 13:31:04.269327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 457/929] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:04 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:04.291323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:04.299453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-95ece524-8450-492e-8a1e-d3d17330ad1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.158677 Oct 27 13:31:04.300026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 473/930] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:04 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:04.413667 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:04.413789 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:04.420338 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.420837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.421281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.421990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:04.422451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:04.422882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:04.563260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:04.566807 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:04.573256 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:04.574665 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:04.575939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-107723c0-066f-4db5-94d8-a097a8d08ee2 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.167057 Oct 27 13:31:04.576806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 458/931] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:04 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:04.918968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-829454788", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-936264149", "security_groups": [{"name": "tempest-secgroup-smoke-1629517"}], "block_device_mapping_v2": [{"uuid": "3c0f869b-4c39-4ae6-a6fd-39e4c48bf69b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c8f3dd5-6b59-4fe5-89a4-312211a0043d"}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:05.034026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] validate_networks() for [('1c8f3dd5-6b59-4fe5-89a4-312211a0043d', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:31:05.290939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:05.291579 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:05.298032 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.298521 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.298954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.299648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.300096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.300548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.444640 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:31:05.445775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:31:05.446494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:31:05.447128 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:31:05.447451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.447830 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:31:05.457969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.458674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.459328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.460304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.460999 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.461613 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.465801 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5e95f797-27db-490c-9ec7-35b9dbd24e4f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.178659 Oct 27 13:31:05.466659 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 459/932] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:05 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:05.479103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:05.481596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:05.489755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.490043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.490523 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.491276 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.491733 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.492158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.496427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:31:05.501851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for user a41fc97ca6ea4a1c8201f068b26e6888 and project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:31:05.565584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:31:05.567847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c0f869b-4c39-4ae6-a6fd-39e4c48bf69b',volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:31:05.647402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.660147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a94ebe37-b658-4ca1-8b8f-f708a332aeee tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1314 microversion: 2.1 time: 0.184690 Oct 27 13:31:05.660894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 460/933] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:05 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:05.666164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:05.666915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:05.674215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.674980 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.675518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.676513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:05.677193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:05.677832 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:05.832204 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e73f1562-eb8b-4035-a054-c8057b985862 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.910344 Oct 27 13:31:05.834662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 474/934] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:31:04 2022] POST /compute/v2.1/servers => generated 403 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:31:05.856928 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b246c1da-ff1d-4668-bf7d-12344cd98ee9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:05.857906 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b246c1da-ff1d-4668-bf7d-12344cd98ee9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:05.907588 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.918155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.921357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.922969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-18daa8b8-30fb-44b6-8530-72afaaac1745 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.260812 Oct 27 13:31:05.924624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 461/935] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:05 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:05.979131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b246c1da-ff1d-4668-bf7d-12344cd98ee9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:05.993407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b246c1da-ff1d-4668-bf7d-12344cd98ee9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1093 microversion: 2.1 time: 0.151884 Oct 27 13:31:06.003314 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 475/936] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:05 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1093 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:06.491018 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:06.491724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:06.499932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.500465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.500909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:06.501623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.502080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.502645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:06.654529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:06.662147 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0f28f8e3-a298-427b-b7b1-fa847138a7b2 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.176651 Oct 27 13:31:06.662706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 462/937] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:06 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:06.685397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:06.686024 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:06.693943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.695062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.695649 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:06.696604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.697145 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.697584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:06.896489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:06.905773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-08d1d022-b6e0-4878-b371-59123a8ae776 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1498 microversion: 2.1 time: 0.224620 Oct 27 13:31:06.906710 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 476/938] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:06 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1498 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:06.960598 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:06.961363 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:06.968105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.968723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.969264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:06.970176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:06.970739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:06.971165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.019304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:07.019839 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:07.025876 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.026364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.026800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.027506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.027989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.028632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.104503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.113141 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-39002007-c785-4ef7-982d-504c6b39104f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1191 microversion: 2.1 time: 0.098324 Oct 27 13:31:07.113877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 477/939] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:07 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1191 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:07.140664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.161729 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.163304 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.167649 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-feb840b8-34ce-44bd-99ce-0e907d27b9d0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.210886 Oct 27 13:31:07.171383 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 463/940] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:06 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:07.439520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:07.440026 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:07.446101 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.446573 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.447012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.447713 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.448221 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.448812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.474227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:31:07.552680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-aa10d48c-3983-4fec-b146-2d08a162740b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "DELETE /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 204 len: 0 microversion: 2.1 time: 0.116608 Oct 27 13:31:07.553842 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 478/941] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:31:07 2022] DELETE /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:31:07.562271 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:07.563115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:07.569679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.570307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.570625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.571331 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.571790 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.572222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.685669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:07.686388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:07.692751 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.693248 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.693693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.694411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:07.694870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:07.695301 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:07.720956 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.731138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-444143cb-07c6-4aa9-a9e3-1ffd11d04a90 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1504 microversion: 2.1 time: 0.173095 Oct 27 13:31:07.732737 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 464/942] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:07 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:07.836967 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:07.845522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a2c01891-9b3e-41f0-8e1d-098c22015e9c tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.163831 Oct 27 13:31:07.845735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 479/943] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:07 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:08.139882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:08.140464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:08.146510 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.146993 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.147429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.148120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.148612 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.149042 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.197049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:08.197669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:08.204189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.204712 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.205154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.205883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.206348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.206779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.214092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:08.222636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a09e5028-6ae8-4c1f-955b-d061ce6809cd tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1209 microversion: 2.1 time: 0.087170 Oct 27 13:31:08.223215 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 465/944] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:08 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:08.346328 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:08.353705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:08.355153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:08.357020 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-107d5a9c-aec8-40b4-950a-076958566db4 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.163164 Oct 27 13:31:08.357495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 480/945] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:08 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 27 13:31:08.755187 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:08.755720 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:08.761991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.762972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.763401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.764082 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.764553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.764967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.868924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:08.869552 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:08.876153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.876677 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.877114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.877815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:08.878272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:08.878699 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:08.894444 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:08.902193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c3ce412f-2a25-4e09-b0dc-df4e875ecdaf tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1504 microversion: 2.1 time: 0.150878 Oct 27 13:31:08.902775 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 466/946] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:08 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:09.027561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:09.035380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-89ca87b3-d2bc-4961-92f7-1ee81502ad91 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.170282 Oct 27 13:31:09.036843 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 481/947] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:08 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:09.245592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:09.246204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:09.252765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.253248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.253676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.254367 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.254813 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.255231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.316889 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:09.324711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-71f98194-06c0-40ae-a27d-b752855e9b63 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1209 microversion: 2.1 time: 0.083163 Oct 27 13:31:09.325870 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 467/948] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:09 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:09.383404 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:09.384016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:09.390939 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.391533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.392034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.392852 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.393320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.394708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.768014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:09.774298 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:09.781795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:09.783437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:09.784686 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3ae50a80-9f7c-443d-9246-ab4e530d08a6 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.405413 Oct 27 13:31:09.785335 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 482/949] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:09 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:09.887931 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "name": "network-vif-plugged", "status": "completed", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:09.898179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.898898 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.899520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.915443 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] Creating event network-vif-plugged:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:31:09.921467 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-b4aea124-63e1-48e9-8dcb-329493e2dd64 req-5e8b2f4d-c714-4625-87a9-296af7f8baa7 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037096 Oct 27 13:31:09.922634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 468/950] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:09.926625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:09.927272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:09.952199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.953756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.954500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:09.955568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:09.956357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:09.956986 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.059906 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:10.060653 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:10.074314 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.075063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.075713 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.076560 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.077107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.077556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.398591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:10.416590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3d92acb9-f595-4129-aa46-c9a8596e22c6 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1504 microversion: 2.1 time: 0.488738 Oct 27 13:31:10.417629 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 483/951] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:09 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1504 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:10.428110 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:10.428776 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:10.437615 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.438656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.439318 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.440641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.441297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.443189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.476628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:10.487299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7f11f209-5c95-4a2a-ae65-1f276fddc897 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.432399 Oct 27 13:31:10.489373 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 469/952] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:10 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:10.683879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60173dcf-6c4d-49f4-a9be-49396bb2013c", "name": "network-vif-deleted", "tag": "d1d1a827-63f9-4c8d-8776-78408c57852b"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:10.711298 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.712350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.713259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.730073 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] Creating event network-vif-deleted:d1d1a827-63f9-4c8d-8776-78408c57852b for instance 60173dcf-6c4d-49f4-a9be-49396bb2013c on hv-cinder-86243 Oct 27 13:31:10.737915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-16afad7c-eaf9-4eda-99be-8fe691ee62c5 req-7dd049e6-7b03-4928-97c7-55ba6f8cdc44 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058180 Oct 27 13:31:10.739454 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 470/953] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:10.808683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:10.812456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:10.813168 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:10.821044 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.821549 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.822043 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.822213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a9d142a3-f4d7-46c0-957b-0315631b5c4e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.401684 Oct 27 13:31:10.822754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:10.823134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 484/954] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:10 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:10.823530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:10.823960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:10.989087 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:10.999658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:11.001246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:11.002441 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-859fc0e4-b742-448c-a329-ee53de6fad14 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.195006 Oct 27 13:31:11.003004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 471/955] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:10 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:11.444659 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:11.445941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:11.452867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.453363 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.453801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.454530 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.454991 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.455604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.491815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.492347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.492776 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.493229 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lazy-loading 'fault' on Instance uuid 60173dcf-6c4d-49f4-a9be-49396bb2013c {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:31:11.512685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:11.513329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:11.519780 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.520297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.520959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.521666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.522121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.522550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.557859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:11.566864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-10b13177-05d1-4a73-a20b-7656086aab5d tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 200 len: 1304 microversion: 2.1 time: 0.125849 Oct 27 13:31:11.568503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 485/956] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:11 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 1304 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:11.755311 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:11.767217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-639b6f69-3bcf-412f-b211-43dbca7c5ffb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.258786 Oct 27 13:31:11.771564 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 472/957] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:11 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:11.850444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:11.851060 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:11.857602 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.858320 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.858767 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.859481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.859941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.860398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.950832 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164aa13-2f80-4ec4-b981-3eafb193fa9d", "name": "network-vif-plugged", "status": "completed", "tag": "aab2e22a-bc37-4db4-9d43-12304845eb83"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:11.963906 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:11.964662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:11.965281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:11.981910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] Creating event network-vif-plugged:aab2e22a-bc37-4db4-9d43-12304845eb83 for instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d on hv-cinder-86243 Oct 27 13:31:11.994765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-ae28172c-bf9c-49cf-bee2-1270aa016cd9 req-fdef8ced-6917-487f-a023-89b20a94a50d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048437 Oct 27 13:31:12.001008 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 473/958] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:31:12.028990 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:12.030306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:12.038232 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.039108 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.039705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.040827 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.041468 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.042066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.137559 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:12.162891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9426687e-8224-4d1b-a0c1-416490167c79 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.316307 Oct 27 13:31:12.166970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 486/959] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:11 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:12.307014 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:12.318888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:12.321280 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:12.323672 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0cd69512-8989-4e25-a6a7-8245cec54f11 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1731 microversion: 2.20 time: 0.300143 Oct 27 13:31:12.337150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 474/960] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:12 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1731 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:12.598430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:12.599143 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: 60173dcf-6c4d-49f4-a9be-49396bb2013c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:12.613371 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.613955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.614475 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.615284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.615851 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.616786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.632953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] HTTP exception thrown: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Request method failure captured: Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c HTTP/1.1 Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofzBOG_CXHGORq63q5XGRTzVNTTMxhkecZIDWQ6tS0Kx7HTmIqRTQuQZHRKOoZXJGmp9FZvlHU2c2xEDG8aIy7CvGeCAVYL_Iz6K4HBNEqdbBHK3U8i-ySX0EWu14dXrIPl56DEUuVt8EdAloDKJ5j6D9znUcgDiDmYMgwVw7G7ZGI Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 9f309e5e9bf84fff939c088e7c256bfb Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:31:12.635574 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 9f309e5e9bf84fff939c088e7c256bfb Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesActionsTest-1137781623-project Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 261dfac380ce4eb28eb197cd512b6edc Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesActionsTest-1137781623-project Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. Oct 27 13:31:12.637825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '60173dcf-6c4d-49f4-a9be-49396bb2013c'} Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:12.638791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. Oct 27 13:31:12.640848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:12.642663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Returning 404 to user: Instance 60173dcf-6c4d-49f4-a9be-49396bb2013c could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:12.642663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c05e7867-1ada-4fcd-b287-6b9cf90a228b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c" status: 404 len: 111 microversion: 2.1 time: 0.047228 Oct 27 13:31:12.642663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 487/961] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:12 2022] GET /compute/v2.1/servers/60173dcf-6c4d-49f4-a9be-49396bb2013c => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:31:12.773286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-319427486", "imageRef": "f55bd190-3c7f-49bd-b0e9-b9012d39fc8b", "flavorRef": "452", "networks": [{"uuid": "cf9d9e9d-f4b9-457d-9d91-950e7084e959"}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:12.806380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14588610-98fd-455b-9380-16dbcd733d9f", "tag": "6f0a58f6-2585-493b-a27f-602a89862c6f"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:12.819068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.819570 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.820006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.834718 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] Creating event network-changed:6f0a58f6-2585-493b-a27f-602a89862c6f for instance 14588610-98fd-455b-9380-16dbcd733d9f on hv-cinder-86243 Oct 27 13:31:12.841177 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-68dfed0e-8128-4ca0-b8ec-4811d551f419 req-29d7681c-0e50-4d86-b053-255ad661fb0b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053852 Oct 27 13:31:12.842568 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 488/962] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:31:12.851261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:12.852480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:12.856134 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:12.856534 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] validate_networks() for [('cf9d9e9d-f4b9-457d-9d91-950e7084e959', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:31:12.861878 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.862778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.863234 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:12.863994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:12.864495 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:12.864935 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.019561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.027808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-dad27126-1209-461a-bd07-690512967924 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.180977 Oct 27 13:31:13.028411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 489/963] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:12 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:13.190904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:13.191638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:13.198023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.198520 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.198959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.199698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.200157 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.200638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.437288 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.445783 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c1bb06fa-e1b5-4a3a-96ed-6f9344b82cbb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.258753 Oct 27 13:31:13.456158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 490/964] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:13 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:13.456158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:13.456158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:13.460916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.460916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.460916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.460916 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.461203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.461401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.506150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:31:13.506651 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:31:13.507028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:31:13.507436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:31:13.507840 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:31:13.517269 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.517751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.518177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.518897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:13.519351 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:13.519776 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:13.536440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Getting quotas for project 9f309e5e9bf84fff939c088e7c256bfb. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:31:13.540410 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Getting quotas for user 261dfac380ce4eb28eb197cd512b6edc and project 9f309e5e9bf84fff939c088e7c256bfb. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:31:13.551350 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:31:13.553705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f55bd190-3c7f-49bd-b0e9-b9012d39fc8b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:31:13.604284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7a458ff0-9a79-485a-8795-b716ec076ee2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.835126 Oct 27 13:31:13.605179 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 475/965] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:31:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 837 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:31:13.616887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5ffbac13-d969-47cc-b9f9-30cc415956a3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:13.617601 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5ffbac13-d969-47cc-b9f9-30cc415956a3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:13.619681 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:13.645077 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.654243 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.655911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.657543 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f9440e9f-9b9f-42e0-afdc-28309cbfeef0 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1718 microversion: 2.20 time: 0.209825 Oct 27 13:31:13.658578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 491/966] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:13 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1718 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:13.678287 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5ffbac13-d969-47cc-b9f9-30cc415956a3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:13.687438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5ffbac13-d969-47cc-b9f9-30cc415956a3 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1213 microversion: 2.1 time: 0.075270 Oct 27 13:31:13.688017 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 476/967] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:13 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1213 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:14.050731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:14.051360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:14.057612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.058111 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.058551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.059361 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.059826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.060325 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.305994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:14.314462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-16760309-a492-48de-858b-52676f76ed90 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1368 microversion: 2.1 time: 0.267573 Oct 27 13:31:14.315327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 492/968] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:14 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1368 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:14.472691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:14.473301 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:14.479819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.480339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.480779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.481476 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.481937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.482366 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.629757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:14.637686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3cafac3e-9f0e-4ebb-ab63-2c06368644fe tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.168921 Oct 27 13:31:14.638252 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 477/969] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:14 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:14.711815 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:14.712562 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:14.719302 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.720165 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.720657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.721368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:14.721826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:14.722245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:14.822664 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:14.830973 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9f9fa652-daed-40bc-a45d-757696190fef tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1273 microversion: 2.1 time: 0.123031 Oct 27 13:31:14.831561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 493/970] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:14 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1273 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:15.339686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:15.340993 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:15.348194 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.348751 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.349191 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.350484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.350484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.350935 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.528334 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:15.537259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b45fc0f0-71a8-4e03-95a7-327318466fde tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1558 microversion: 2.1 time: 0.202443 Oct 27 13:31:15.538686 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 478/971] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:15 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1558 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:15.561049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:15.561557 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:15.563500 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:15.569059 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.569542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.570012 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.570742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.571205 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.571638 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.662307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:15.662988 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:15.669589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.670117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.670756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.671490 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.671954 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.672416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.677094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:15.690389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-db7588ba-2fb2-473e-b7f2-615ce5838f5b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133392 Oct 27 13:31:15.691113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 494/972] 10.222.0.48 () {58 vars in 1275 bytes} [Thu Oct 27 13:31:15 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:15.859929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:15.864313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:15.871195 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.872667 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.873607 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.874414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:15.874938 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:15.875430 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:15.995342 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=8 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:15.997867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:16.009267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0431c137-9fd0-4acf-9da7-ade54f8fbf80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.350885 Oct 27 13:31:16.024316 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 479/973] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:15 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:16.364833 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:16.373716 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5e552699-102c-4f9a-9607-1e1f77ba3ef4 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.521209 Oct 27 13:31:16.384518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 495/974] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:15 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:16.623122 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b81ad4d4-67aa-42c4-9c2d-c26af67052dd", "tag": "a904eefe-50db-468a-b35d-6728da34e6a1"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:16.635655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:16.636565 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:16.637259 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:16.650505 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] Creating event network-changed:a904eefe-50db-468a-b35d-6728da34e6a1 for instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd on hv-cinder-86243 Oct 27 13:31:16.656145 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-a54687df-77b6-4172-941f-b5932a469307 req-9bea73c1-bf09-4e3b-8067-851fb317cb47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037659 Oct 27 13:31:16.656787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 480/975] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:31:16.783160 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5164aa13-2f80-4ec4-b981-3eafb193fa9d", "tag": "aab2e22a-bc37-4db4-9d43-12304845eb83"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:16.793837 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:16.794654 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:16.795156 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:16.806633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] Creating event network-changed:aab2e22a-bc37-4db4-9d43-12304845eb83 for instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d on hv-cinder-86243 Oct 27 13:31:16.817296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-0cbc9e67-c847-495e-b317-4794d4a08699 req-8e97e8f0-ead1-493e-a507-93ad2a914e07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037525 Oct 27 13:31:16.818175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 496/976] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:17.035309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:17.036815 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:17.043732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:17.044376 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:17.044915 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:17.045727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:17.046484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:17.047090 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:17.208996 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:17.218689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1082eeb2-f893-4e3e-9262-309128d74549 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.188064 Oct 27 13:31:17.226118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 481/977] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:17 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:17.400822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:17.401563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:17.408159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:17.408703 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:17.409148 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:17.409867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:17.410322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:17.410743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:17.553910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:17.562663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d5534d24-cf6c-4bc8-ab98-3ca738ec8d98 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.167129 Oct 27 13:31:17.563256 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 497/978] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:17 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:18.241674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:18.242302 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:18.249833 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:18.250325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:18.250760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:18.251468 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:18.251923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:18.252379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:18.393022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:18.400875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-785d5707-9222-4605-98b7-ec8deca74cc0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.163224 Oct 27 13:31:18.401452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 482/979] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:18 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:18.585961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:18.586609 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:18.593549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:18.594055 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:18.594497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:18.595212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:18.595676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:18.596106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:18.737668 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:18.745516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f46d50a1-e059-4e71-b363-4b40ac215abd tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.163493 Oct 27 13:31:18.746099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 498/980] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:18 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:19.423428 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:19.424001 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:19.430698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:19.431189 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:19.431627 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:19.432362 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:19.432820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:19.433246 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:19.597949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:19.605960 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8a7ab4b4-f936-402a-8304-99894bda5a80 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.186680 Oct 27 13:31:19.606528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 483/981] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:19 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:19.769239 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:19.769924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:19.776473 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:19.776968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:19.777824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:19.778541 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:19.779000 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:19.779427 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:19.915863 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:19.924172 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-76828aa3-aaf1-47fe-927a-c15977e62329 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.158927 Oct 27 13:31:19.924790 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 499/982] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:19 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:20.629333 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:20.629943 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:20.636513 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:20.637621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:20.638049 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:20.638739 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:20.639182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:20.639600 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:20.770308 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:20.779027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6a3cdca5-f12c-4e88-96f5-826009c5340c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.153117 Oct 27 13:31:20.779734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 484/983] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:20 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:20.947003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:20.947571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:20.953694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:20.954208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:20.954645 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:20.955369 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:20.955826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:20.956271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:21.084697 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:21.092923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1d0e8286-d1e9-4723-91ed-c1254e94dbd7 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.149882 Oct 27 13:31:21.093489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 500/984] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:20 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:21.687866 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14588610-98fd-455b-9380-16dbcd733d9f", "name": "network-vif-plugged", "status": "completed", "tag": "6f0a58f6-2585-493b-a27f-602a89862c6f"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:21.698257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:21.698743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:21.699192 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:21.710844 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] Creating event network-vif-plugged:6f0a58f6-2585-493b-a27f-602a89862c6f for instance 14588610-98fd-455b-9380-16dbcd733d9f on hv-cinder-86243 Oct 27 13:31:21.716171 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-071e0dfc-b50b-42e7-ab2b-fa20a26120f9 req-1bb3a2ee-fbbf-46c0-9a8c-d0b70bd5117b service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Oct 27 13:31:21.716802 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 485/985] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:21.801826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:21.802443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:21.808862 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:21.809357 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:21.809794 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:21.810501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:21.810957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:21.811410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:21.829750 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=100 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:22.010040 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:22.017866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a64461d0-2075-4fa6-92bd-ffe84068a16e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.220234 Oct 27 13:31:22.018450 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 501/986] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:21 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:22.116645 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:22.117345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:22.123893 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:22.124453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:22.124885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:22.125747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:22.126199 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:22.126621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:22.259292 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:22.267553 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d7de582c-55d2-446b-87a6-9e5fad5c8123 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.155157 Oct 27 13:31:22.268119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 486/987] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:22 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:23.040872 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:23.041487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:23.048462 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:23.048944 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:23.049385 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:23.050075 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:23.050560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:23.050988 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:23.183220 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:23.191554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fadca0f6-c7b8-4d4b-8384-f8a3851e982c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1262 microversion: 2.1 time: 0.154521 Oct 27 13:31:23.192125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 502/988] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:23 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:23.290921 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:23.291557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:23.298536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:23.299022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:23.299451 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:23.300162 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:23.300666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:23.301084 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:23.433162 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:23.441078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2da01442-f31f-4084-8167-880ae1900e1a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.154026 Oct 27 13:31:23.441592 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 487/989] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:23 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:23.755739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81ad4d4-67aa-42c4-9c2d-c26af67052dd", "name": "network-vif-plugged", "status": "completed", "tag": "a904eefe-50db-468a-b35d-6728da34e6a1"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:23.765177 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:23.765656 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:23.766089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:23.776900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] Creating event network-vif-plugged:a904eefe-50db-468a-b35d-6728da34e6a1 for instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd on hv-cinder-86243 Oct 27 13:31:23.781705 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-dc97c108-3e22-478f-ba0c-e9ed369eac88 req-6ca25975-e34d-48b2-954a-6faa6bc5e1d8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029576 Oct 27 13:31:23.782276 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 503/990] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:24.213117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:24.213723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:24.216155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:24.216987 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=8 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:24.223396 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.223874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.224342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.225106 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.225480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.225894 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.358879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:24.366899 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-51eaf82c-d373-4ce1-9644-1547a437e092 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1448 microversion: 2.1 time: 0.157670 Oct 27 13:31:24.367474 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 488/991] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:24 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1448 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:24.392526 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:24.393228 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:24.399502 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.400043 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.400503 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.401189 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.401637 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.402814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.465530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:24.466144 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:24.471926 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.472446 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.472884 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.473580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:24.474034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:24.474463 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:24.533405 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:24.541621 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-35a0d644-475e-4157-a40a-2c13d4515369 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1448 microversion: 2.1 time: 0.153723 Oct 27 13:31:24.542403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 504/992] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:24 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1448 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:24.611625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:24.620348 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6054faca-ba54-4953-96d8-0c3b365779b2 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1313 microversion: 2.1 time: 0.159326 Oct 27 13:31:24.620938 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 489/993] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:24 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:31:25.643117 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:25.644588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:25.651238 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:25.651723 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:25.652768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:25.653466 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:25.653954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:25.654378 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:25.791211 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:25.799639 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-c14acedf-90bc-427f-975a-23cde6bb9a16 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1496 microversion: 2.1 time: 0.160478 Oct 27 13:31:25.800438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 505/994] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:25 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1496 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:26.264166 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:26.264724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:26.271138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:26.271625 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:26.272064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:26.272800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:26.273261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:26.273689 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:26.286617 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14588610-98fd-455b-9380-16dbcd733d9f", "tag": "6f0a58f6-2585-493b-a27f-602a89862c6f"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:26.297551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:26.298146 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:26.298657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:26.301417 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:31:26.311540 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] Creating event network-changed:6f0a58f6-2585-493b-a27f-602a89862c6f for instance 14588610-98fd-455b-9380-16dbcd733d9f on hv-cinder-86243 Oct 27 13:31:26.316748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-2704cce0-8f48-44e3-b2aa-a59b5745f353 req-a7974ea6-a8c4-447d-84a6-ddf6f667a989 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034092 Oct 27 13:31:26.317437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 506/995] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:31:26.386890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-273a8397-c83d-43d8-ac7a-5ef6066b5461 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "DELETE /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 204 len: 0 microversion: 2.1 time: 0.126027 Oct 27 13:31:26.387462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 490/996] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:31:26 2022] DELETE /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:31:26.397031 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:26.397752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:26.409497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:26.410008 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:26.410479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:26.411365 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:26.411913 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:26.412482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:26.582285 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:26.590953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-519236a5-524d-41c5-b375-9d53067b2761 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1502 microversion: 2.1 time: 0.198703 Oct 27 13:31:26.591987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 507/997] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:26 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1502 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:27.617604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:27.618320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:27.625261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:27.625675 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:27.626112 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:27.626851 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:27.627303 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:27.627731 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:28.032499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:28.041355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-30bb8d5f-021f-4a4a-8f20-647560d45e13 tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1502 microversion: 2.1 time: 0.428292 Oct 27 13:31:28.041927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 491/998] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:27 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1502 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:28.516902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b81ad4d4-67aa-42c4-9c2d-c26af67052dd", "name": "network-vif-deleted", "tag": "a904eefe-50db-468a-b35d-6728da34e6a1"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:28.527343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:28.527816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:28.528261 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:28.540875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] Creating event network-vif-deleted:a904eefe-50db-468a-b35d-6728da34e6a1 for instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd on hv-cinder-86243 Oct 27 13:31:28.545879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-90f1a4b6-8548-4f4e-b53f-f76b6f2278d0 req-69cf6ec9-dfc0-45d1-8f6b-296be90b2db4 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032579 Oct 27 13:31:28.546472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 508/999] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:29.065299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:29.065928 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:29.072307 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:29.072794 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:29.073234 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:29.074437 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:29.074886 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:29.075499 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:29.108623 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:29.109111 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:29.109548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:29.109995 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lazy-loading 'fault' on Instance uuid b81ad4d4-67aa-42c4-9c2d-c26af67052dd {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:31:29.155051 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '261dfac380ce4eb28eb197cd512b6edc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f309e5e9bf84fff939c088e7c256bfb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:29.162066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-55f372ee-abb1-4b61-83f4-efb287faac7a tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 200 len: 1303 microversion: 2.1 time: 0.100706 Oct 27 13:31:29.162658 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 492/1000] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:29 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:30.187199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:30.187912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] [instance: b81ad4d4-67aa-42c4-9c2d-c26af67052dd] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:30.194297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:30.194786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:30.195225 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:30.195942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:30.196460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:30.196889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:30.211883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] HTTP exception thrown: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Request method failure captured: Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd HTTP/1.1 Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofzBOG_CXHGORq63q5XGRTzVNTTMxhkecZIDWQ6tS0Kx7HTmIqRTQuQZHRKOoZXJGmp9FZvlHU2c2xEDG8aIy7CvGeCAVYL_Iz6K4HBNEqdbBHK3U8i-ySX0EWu14dXrIPl56DEUuVt8EdAloDKJ5j6D9znUcgDiDmYMgwVw7G7ZGI Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 9f309e5e9bf84fff939c088e7c256bfb Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:31:30.213604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_9f309e5e9bf84fff939c088e7c256bfb"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 9f309e5e9bf84fff939c088e7c256bfb Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesActionsTest-1137781623 Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesActionsTest-1137781623-project Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 261dfac380ce4eb28eb197cd512b6edc Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesActionsTest-1137781623-project Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. Oct 27 13:31:30.215002 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'b81ad4d4-67aa-42c4-9c2d-c26af67052dd'} Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:30.215736 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. Oct 27 13:31:30.217203 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:30.218663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] Returning 404 to user: Instance b81ad4d4-67aa-42c4-9c2d-c26af67052dd could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:30.218663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8fa71598-6621-4599-9e3c-f3bea297765b tempest-VolumesActionsTest-1137781623 tempest-VolumesActionsTest-1137781623-project] 10.222.0.48 "GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd" status: 404 len: 111 microversion: 2.1 time: 0.033246 Oct 27 13:31:30.218663 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 509/1001] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:31:30 2022] GET /compute/v2.1/servers/b81ad4d4-67aa-42c4-9c2d-c26af67052dd => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:31:52.357877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:52.359045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:52.363331 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:52.365652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:52.374203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.374697 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.375168 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.375877 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.376433 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.376883 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.409874 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c4ff0c05-532f-4d76-9583-c0d1529356c8 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.053244 Oct 27 13:31:52.410445 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 493/1002] 10.222.0.48 () {60 vars in 1343 bytes} [Thu Oct 27 13:31:52 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:31:52.474624 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:52.475135 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:52.477505 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=40 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:52.478912 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=35 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:31:52.485161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.485651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.486090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.486806 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.487264 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.487695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.513698 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:31:52.608171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d76de006-cbd4-42ed-a63b-c32ea762cb1c tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 204 len: 0 microversion: 2.20 time: 0.137095 Oct 27 13:31:52.612507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 510/1003] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Oct 27 13:31:52 2022] DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 13:31:52.623235 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:52.623941 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:52.629973 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.630465 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.630912 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.631631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:52.632077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:52.632724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:52.770867 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:52.780039 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:52.781606 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:52.782880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-98e09641-4b65-4093-94db-c97455e61497 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.165016 Oct 27 13:31:52.795696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 494/1004] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:52 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:53.811133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:53.811841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:53.818380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:53.818873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:53.819313 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:53.820019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:53.820506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:53.820937 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:53.955075 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:53.963114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:53.964571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:53.965729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4dde17b9-3760-41fb-aa84-3053ef2263c5 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1724 microversion: 2.20 time: 0.159814 Oct 27 13:31:53.966278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 511/1005] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:53 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:54.992221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:54.992847 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:55.000577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:55.001065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:55.001501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:55.002388 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:55.002837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:55.003370 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:55.068925 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:55.078462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:55.079918 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e77228bb97fd40dfa311088f28864637', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a14a3cf9df9f4034a8a0109fd3e33816', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:31:55.081158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ece155df-86c7-4247-8e9a-864731733653 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 200 len: 1657 microversion: 2.20 time: 0.092916 Oct 27 13:31:55.081958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 495/1006] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:54 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 1657 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 27 13:31:55.301970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f232f466-e821-48fe-926c-feadcec39c31", "name": "network-vif-deleted", "tag": "75bff678-d298-4825-99f8-3b2c8c43c102"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:31:55.314619 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:55.315372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:55.315974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:55.330226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] Creating event network-vif-deleted:75bff678-d298-4825-99f8-3b2c8c43c102 for instance f232f466-e821-48fe-926c-feadcec39c31 on hv-cinder-86243 Oct 27 13:31:55.335266 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-cbb68e8a-9139-4bb9-bdba-cdeb91b856b9 req-20e8af15-cae7-46c2-bee8-61205d955e47 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037370 Oct 27 13:31:55.335808 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 512/1007] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:31:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:31:56.106584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:56.107392 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:56.114212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:56.114793 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:56.115297 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:56.116007 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:56.116518 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:56.116944 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:56.131094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 HTTP/1.1 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:31:56.132837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:56.135150 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'f232f466-e821-48fe-926c-feadcec39c31'} Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:56.136066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:56.137773 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:56.139212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:56.139212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-00d554f8-02e0-466d-b998-1bbe3d356fe9 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 404 len: 111 microversion: 2.20 time: 0.031736 Oct 27 13:31:56.139212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 496/1008] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:56 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:31:56.144798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-24b5260c-5b9e-459d-aa11-b9a7a948dc06 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '.version_select at 0x7fb373306d30>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:56.165274 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-24b5260c-5b9e-459d-aa11-b9a7a948dc06 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576321005" status: 204 len: 0 microversion: 2.20 time: 0.024602 Oct 27 13:31:56.165874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 513/1009] 10.222.0.48 () {60 vars in 1262 bytes} [Thu Oct 27 13:31:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1576321005 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 27 13:31:57.931752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:57.932248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:57.938538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:57.939047 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:57.939485 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:57.940176 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:57.940654 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:57.941079 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:57.954164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 HTTP/1.1 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:31:57.955700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.957435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'f232f466-e821-48fe-926c-feadcec39c31'} Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:57.958335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.959897 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.961488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:57.961488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-558126c5-a8dd-4585-b6fe-33a78b52d684 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 404 len: 111 microversion: 2.20 time: 0.029211 Oct 27 13:31:57.961488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 497/1010] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Oct 27 13:31:57 2022] DELETE /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:31:57.966030 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:57.966789 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: f232f466-e821-48fe-926c-feadcec39c31] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:57.973707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:57.974212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:57.974649 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:57.975334 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:57.975786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:57.976208 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:57.990099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 HTTP/1.1 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:31:57.991754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.993884 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'f232f466-e821-48fe-926c-feadcec39c31'} Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:57.994641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. Oct 27 13:31:57.995897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:57.997308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance f232f466-e821-48fe-926c-feadcec39c31 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:57.997308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7501429e-5566-498b-9320-571e81d06312 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31" status: 404 len: 111 microversion: 2.20 time: 0.031496 Oct 27 13:31:57.997308 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 514/1011] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:57 2022] GET /compute/v2.1/servers/f232f466-e821-48fe-926c-feadcec39c31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:31:59.135979 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:59.136525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:59.142900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:59.143426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:59.143824 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:59.144555 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:59.145013 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:59.145435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:59.159103 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c HTTP/1.1 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:31:59.161196 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.162845 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '896767c6-1a1e-4729-992a-7d4dfa6b503c'} Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:59.163727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.165782 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.167267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:59.167267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aadad4e1-08c3-4f76-8cae-752a692f0036 tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 404 len: 111 microversion: 2.20 time: 0.030745 Oct 27 13:31:59.167267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 498/1012] 10.222.0.48 () {60 vars in 1280 bytes} [Thu Oct 27 13:31:59 2022] DELETE /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 27 13:31:59.172205 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:31:59.172867 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] [instance: 896767c6-1a1e-4729-992a-7d4dfa6b503c] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:31:59.179199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:59.179682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:59.180124 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:59.181507 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:31:59.181966 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:31:59.182396 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:31:59.195515 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] HTTP exception thrown: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Request method failure captured: Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c HTTP/1.1 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoZ1gqF8ROCpniqoQ7mA0CYfwXduuDJwxnCUkjKWTzADV6sCjWFrVXB-V23pfV4b0FXqeTRjglGddAvzaSQdrVQI7DYgVc8HymIRQWb8rtWHHa5uhlJSeMsl1A_BR8bjQdPg5wdbLuKCaOeolnfIMZsOSiIygx9gvpV6uirWJSrDduM Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Openstack-Nova-Api-Version: 2.20 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:31:59.197113 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a14a3cf9df9f4034a8a0109fd3e33816"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: a14a3cf9df9f4034a8a0109fd3e33816 Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-616272156 Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: e77228bb97fd40dfa311088f28864637 Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeShelveTestJSON-616272156-project Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.198873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '896767c6-1a1e-4729-992a-7d4dfa6b503c'} Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:31:59.199905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. Oct 27 13:31:59.201367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:31:59.202721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] Returning 404 to user: Instance 896767c6-1a1e-4729-992a-7d4dfa6b503c could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:31:59.202721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-1c33e4c0-6b0d-4ff6-be49-e5d965adaebb tempest-AttachVolumeShelveTestJSON-616272156 tempest-AttachVolumeShelveTestJSON-616272156-project] 10.222.0.48 "GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c" status: 404 len: 111 microversion: 2.20 time: 0.030199 Oct 27 13:31:59.202721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 515/1013] 10.222.0.48 () {60 vars in 1277 bytes} [Thu Oct 27 13:31:59 2022] GET /compute/v2.1/servers/896767c6-1a1e-4729-992a-7d4dfa6b503c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 27 13:32:00.545506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:00.546058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:00.552602 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:00.553094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:00.553528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:00.554244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:00.554698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:00.555123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:00.581136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-37056ce0-2592-47e8-bdfa-70c85f36e4f7 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/ips" status: 200 len: 150 microversion: 2.1 time: 0.039472 Oct 27 13:32:00.586093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 499/1014] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:32:00 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:01.979727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb7673a6-70c1-4893-82a7-ee281c630be7"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:32:01.982280 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:01.988993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:01.989494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:01.989940 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:01.990675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:01.991114 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:01.991728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:02.296121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ae08e59f-2f52-4c72-b51e-cc439f9b0000 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "POST /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.320982 Oct 27 13:32:02.296900 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 516/1015] 10.222.0.48 () {60 vars in 1323 bytes} [Thu Oct 27 13:32:01 2022] POST /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:03.994423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-36ff7ba9-2051-4af9-a827-534dee8eb8fd tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Action: 'create', calling method: .version_select at 0x7fb37353bf70>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1966162766"}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:32:04.273545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-36ff7ba9-2051-4af9-a827-534dee8eb8fd tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.418525 Oct 27 13:32:04.274159 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 500/1016] 10.222.0.48 () {60 vars in 1155 bytes} [Thu Oct 27 13:32:03 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 420 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 27 13:32:04.288016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3a8eb6c9-844b-4e68-8603-b2ad2dd8ea05 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3732b75e0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:04.338105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3a8eb6c9-844b-4e68-8603-b2ad2dd8ea05 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 200 len: 345 microversion: 2.1 time: 0.054857 Oct 27 13:32:04.338693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 517/1017] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:04 2022] GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 345 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:05.354357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a169f435-66a0-4f7f-afd6-40af2817ece9 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3734ec9d0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:05.410484 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a169f435-66a0-4f7f-afd6-40af2817ece9 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 200 len: 346 microversion: 2.1 time: 0.061133 Oct 27 13:32:05.411397 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 501/1018] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:05 2022] GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 346 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:32:05.426310 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cac411db-7b2f-4cfd-8aa5-8d6ede6f009c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Action: 'create', calling method: .version_select at 0x7fb37331b790>, body: {"snapshot": {"volume_id": "3ec3e6bc-7702-42f4-ad19-d86bffa81530", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-227029200"}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:32:05.638779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cac411db-7b2f-4cfd-8aa5-8d6ede6f009c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.216851 Oct 27 13:32:05.639532 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 518/1019] 10.222.0.48 () {60 vars in 1162 bytes} [Thu Oct 27 13:32:05 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:05.663941 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3b028dcc-460b-4ec8-97c7-a63b67d6b1c6 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37349edc0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:05.700450 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3b028dcc-460b-4ec8-97c7-a63b67d6b1c6 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 286 microversion: 2.1 time: 0.048770 Oct 27 13:32:05.701211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 502/1020] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:05 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 286 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:05.714561 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-10ca229f-3873-43f9-912e-b0c6c31f1d16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3734609d0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:05.749253 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-10ca229f-3873-43f9-912e-b0c6c31f1d16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039980 Oct 27 13:32:05.749841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 519/1021] 10.222.0.48 () {58 vars in 1140 bytes} [Thu Oct 27 13:32:05 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:05.762416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aa18ed97-c58d-4576-9531-24b26bd5e7ce tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37353b9d0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:05.795083 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aa18ed97-c58d-4576-9531-24b26bd5e7ce tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 286 microversion: 2.1 time: 0.036979 Oct 27 13:32:05.795698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 503/1022] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:05 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:06.808887 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-89cbef69-de1a-4bb2-921a-5a5fd619ae45 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37331baf0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:06.840153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-89cbef69-de1a-4bb2-921a-5a5fd619ae45 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 286 microversion: 2.1 time: 0.035934 Oct 27 13:32:06.840779 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 520/1023] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:06 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:07.854339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bedc81dc-7466-444d-aa46-1cd2aa9ebf23 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb376de9c10>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:07.886045 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bedc81dc-7466-444d-aa46-1cd2aa9ebf23 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 286 microversion: 2.1 time: 0.036535 Oct 27 13:32:07.886648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 504/1024] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:07 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:08.899623 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-23e4ebfc-2cf2-48cb-8e97-44ad876a19e7 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb373434550>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:08.929552 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-23e4ebfc-2cf2-48cb-8e97-44ad876a19e7 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 287 microversion: 2.1 time: 0.034290 Oct 27 13:32:08.930738 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 521/1025] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:08 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:08.942550 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-eddbd870-2c31-48e0-839a-3b1887239dea tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3734ecaf0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:09.014283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-eddbd870-2c31-48e0-839a-3b1887239dea tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "DELETE /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 202 len: 0 microversion: 2.1 time: 0.075989 Oct 27 13:32:09.015094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 505/1026] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Oct 27 13:32:08 2022] DELETE /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:32:09.022919 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f00100e5-4c56-4578-b66a-9afbc71c2037 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3732b7310>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:09.054345 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f00100e5-4c56-4578-b66a-9afbc71c2037 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 200 len: 286 microversion: 2.1 time: 0.034772 Oct 27 13:32:09.055169 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 522/1027] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:09 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 286 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:10.001607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:10.002332 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:10.009074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:10.009574 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:10.010006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:10.010709 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:10.011169 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:10.011596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:10.067269 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4a8b30de-79aa-483e-bb87-b2bc790a42d3 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37331b8b0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:10.093122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-4a8b30de-79aa-483e-bb87-b2bc790a42d3 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] HTTP exception thrown: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. Oct 27 13:32:10.094639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lazy-loading 'services' on Instance uuid 5164aa13-2f80-4ec4-b981-3eafb193fa9d {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4a8b30de-79aa-483e-bb87-b2bc790a42d3 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Request method failure captured: Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a HTTP/1.1 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWohTWjoi6EUgwNaZCGNBxY39WBc58GYQWlu55AIz-xm_07WK2NVTWe09uoRoQq6jrT3WWR5ME07SRfa2faTRP6oshnv90ez5L9k1nqZwa5YPwQ65iZOHwqc6kRgGQc7RudZMNVWG7Vy91tQo37zGYeNqGmTDD5annS6-88B_DldnLus Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:10.095468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 87a2da6d5c4a438b829eab16e9b65361 Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '59069ae7-684f-4465-8881-469658f2d48a'} Oct 27 13:32:10.097001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. (HTTP 404) (Request-ID: req-992237e0-3cfa-4ea7-8486-eab875b3c3db) Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.097870 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:10.099054 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 27 13:32:10.100364 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4a8b30de-79aa-483e-bb87-b2bc790a42d3 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Returning 404 to user: Snapshot 59069ae7-684f-4465-8881-469658f2d48a could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:10.102126 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4a8b30de-79aa-483e-bb87-b2bc790a42d3 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a" status: 404 len: 111 microversion: 2.1 time: 0.033964 Oct 27 13:32:10.102969 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 523/1028] 10.222.0.48 () {58 vars in 1251 bytes} [Thu Oct 27 13:32:10 2022] GET /compute/v2.1/os-snapshots/59069ae7-684f-4465-8881-469658f2d48a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:32:10.105996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ffa7f247-5a87-42c5-8bb8-d8ec370e0492 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3734603a0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:10.175417 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ffa7f247-5a87-42c5-8bb8-d8ec370e0492 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 202 len: 0 microversion: 2.1 time: 0.073159 Oct 27 13:32:10.176259 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 524/1029] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:32:10 2022] DELETE /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:32:10.185326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-044c2810-5e28-4e16-b223-df66a8fdfd4b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments/cb7673a6-70c1-4893-82a7-ee281c630be7" status: 202 len: 0 microversion: 2.1 time: 0.187963 Oct 27 13:32:10.185943 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 506/1030] 10.222.0.48 () {58 vars in 1416 bytes} [Thu Oct 27 13:32:09 2022] DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments/cb7673a6-70c1-4893-82a7-ee281c630be7 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:32:10.188159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-92fc9792-d5e1-474b-a31a-6527576c07f0 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3735628b0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:10.195390 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:10.198596 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:10.205614 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:10.206289 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:10.206770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:10.207743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:10.208203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:10.208854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:10.240703 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e4b28232-40bf-437f-8999-0d7bcc3c67c3 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050057 Oct 27 13:32:10.241290 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 507/1031] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:32:10 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:10.243776 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-92fc9792-d5e1-474b-a31a-6527576c07f0 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 200 len: 345 microversion: 2.1 time: 0.059300 Oct 27 13:32:10.244671 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 525/1032] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:10 2022] GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 345 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:11.255146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.257615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:11.259936 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e989ce94-9b09-4ee7-81f4-20588b45280c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37346fe50>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.264621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.265114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.265555 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.266530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.266992 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.267421 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.287354 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-e989ce94-9b09-4ee7-81f4-20588b45280c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] HTTP exception thrown: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e989ce94-9b09-4ee7-81f4-20588b45280c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Request method failure captured: Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 HTTP/1.1 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWohTWjoi6EUgwNaZCGNBxY39WBc58GYQWlu55AIz-xm_07WK2NVTWe09uoRoQq6jrT3WWR5ME07SRfa2faTRP6oshnv90ez5L9k1nqZwa5YPwQ65iZOHwqc6kRgGQc7RudZMNVWG7Vy91tQo37zGYeNqGmTDD5annS6-88B_DldnLus Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:11.289423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 87a2da6d5c4a438b829eab16e9b65361 Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '3ec3e6bc-7702-42f4-ad19-d86bffa81530'} Oct 27 13:32:11.290773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. (HTTP 404) (Request-ID: req-ce93eb92-8545-4ca5-aecc-5baa9d336d3a) Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.291744 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:11.293100 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 13:32:11.294262 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e989ce94-9b09-4ee7-81f4-20588b45280c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Returning 404 to user: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e989ce94-9b09-4ee7-81f4-20588b45280c tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 404 len: 109 microversion: 2.1 time: 0.035876 Oct 27 13:32:11.295496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 526/1033] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:11 2022] GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:32:11.298006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b153bbfc-0a09-43d9-8a22-4a12d53d1e6b tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047086 Oct 27 13:32:11.298577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 508/1034] 10.222.0.48 () {58 vars in 1302 bytes} [Thu Oct 27 13:32:11 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 27 13:32:11.306641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-260be3c6-2f57-45b9-b6dc-b37216fc8b16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb3737330d0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.338237 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-260be3c6-2f57-45b9-b6dc-b37216fc8b16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] HTTP exception thrown: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-260be3c6-2f57-45b9-b6dc-b37216fc8b16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Request method failure captured: Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 HTTP/1.1 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWohTWjoi6EUgwNaZCGNBxY39WBc58GYQWlu55AIz-xm_07WK2NVTWe09uoRoQq6jrT3WWR5ME07SRfa2faTRP6oshnv90ez5L9k1nqZwa5YPwQ65iZOHwqc6kRgGQc7RudZMNVWG7Vy91tQo37zGYeNqGmTDD5annS6-88B_DldnLus Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:11.340250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 87a2da6d5c4a438b829eab16e9b65361 Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '3ec3e6bc-7702-42f4-ad19-d86bffa81530'} Oct 27 13:32:11.341622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. (HTTP 404) (Request-ID: req-a1858a36-4457-4145-8f66-923633355eb2) Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.342428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 27 13:32:11.343620 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 27 13:32:11.344811 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-260be3c6-2f57-45b9-b6dc-b37216fc8b16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Returning 404 to user: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-260be3c6-2f57-45b9-b6dc-b37216fc8b16 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 404 len: 109 microversion: 2.1 time: 0.040285 Oct 27 13:32:11.346159 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 527/1035] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:32:11 2022] DELETE /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:32:11.350994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bcd1ed16-f5cb-4b01-ad50-64352c7a2210 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Calling method '.version_select at 0x7fb37353bf70>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.371004 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.371866 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:11.378245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.378786 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.379224 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.379995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.380488 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.380754 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-bcd1ed16-f5cb-4b01-ad50-64352c7a2210 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] HTTP exception thrown: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.380907 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bcd1ed16-f5cb-4b01-ad50-64352c7a2210 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Request method failure captured: Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 HTTP/1.1 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWohTWjoi6EUgwNaZCGNBxY39WBc58GYQWlu55AIz-xm_07WK2NVTWe09uoRoQq6jrT3WWR5ME07SRfa2faTRP6oshnv90ez5L9k1nqZwa5YPwQ65iZOHwqc6kRgGQc7RudZMNVWG7Vy91tQo37zGYeNqGmTDD5annS6-88B_DldnLus Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:32:11.383470 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_22fe10c508cc4098b12a7b996f3eb771"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 22fe10c508cc4098b12a7b996f3eb771 Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-667052489 Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 87a2da6d5c4a438b829eab16e9b65361 Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-VolumesSnapshotsTestJSON-667052489-project Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '3ec3e6bc-7702-42f4-ad19-d86bffa81530'} Oct 27 13:32:11.385012 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. (HTTP 404) (Request-ID: req-f987c81c-ff9d-451e-8bb1-3113c5971340) Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.385896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:11.387038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 13:32:11.388163 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. Oct 27 13:32:11.389355 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:11.391010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bcd1ed16-f5cb-4b01-ad50-64352c7a2210 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] Returning 404 to user: Volume 3ec3e6bc-7702-42f4-ad19-d86bffa81530 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:11.392030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bcd1ed16-f5cb-4b01-ad50-64352c7a2210 tempest-VolumesSnapshotsTestJSON-667052489 tempest-VolumesSnapshotsTestJSON-667052489-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530" status: 404 len: 109 microversion: 2.1 time: 0.044955 Oct 27 13:32:11.392635 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 509/1036] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:11 2022] GET /compute/v2.1/os-volumes/3ec3e6bc-7702-42f4-ad19-d86bffa81530 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:11.410726 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:32:11.502083 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-71757179-feca-48da-a0c3-003d3517eedb tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 204 len: 0 microversion: 2.1 time: 0.135033 Oct 27 13:32:11.502763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 528/1037] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:32:11 2022] DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 27 13:32:11.513952 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:11.514495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:11.523964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.524740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.525295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.526511 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:11.527306 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:11.527945 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:11.666939 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:32:11.675091 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dd5564c0-0477-40a4-bec6-12a12c695671 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1683 microversion: 2.1 time: 0.165414 Oct 27 13:32:11.676274 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 510/1038] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:11 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1683 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:32:12.699168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:12.699877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:12.706279 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:12.706762 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:12.707199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:12.707905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:12.708393 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:12.708826 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:12.858942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:32:12.869079 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-95ca4311-60ce-4039-ad17-58a0b62a39c1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1683 microversion: 2.1 time: 0.174622 Oct 27 13:32:12.869753 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 529/1039] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:12 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1683 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:32:13.893587 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:13.894344 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:13.901638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:13.902119 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:13.902551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:13.903254 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:13.903700 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:13.903885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5164aa13-2f80-4ec4-b981-3eafb193fa9d", "name": "network-vif-deleted", "tag": "aab2e22a-bc37-4db4-9d43-12304845eb83"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:32:13.904576 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:13.922383 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:13.922814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:13.923675 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:13.937809 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] Creating event network-vif-deleted:aab2e22a-bc37-4db4-9d43-12304845eb83 for instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d on hv-cinder-86243 Oct 27 13:32:13.946277 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-9c18730b-1ac6-4366-84ba-1b9d45289257 req-726daca6-5061-4380-bb5c-fcc2fc36c4fc service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049425 Oct 27 13:32:13.946995 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 530/1040] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:13.970809 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a385ba4ea6ee4a2fa76f0f12719427ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '095dae174c664eafaf3ed463d8b7f319', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:32:13.982862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-01055c97-6ea5-467b-ba81-4352ed443b60 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 200 len: 1615 microversion: 2.1 time: 0.093187 Oct 27 13:32:13.983452 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 511/1041] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:13 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 1615 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:32:15.006914 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:15.007701 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:15.014460 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:15.014948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:15.015386 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:15.016092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:15.016580 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:15.017016 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:15.032901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d HTTP/1.1 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:15.034685 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:15.036214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '5164aa13-2f80-4ec4-b981-3eafb193fa9d'} Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:15.037147 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:15.038657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:15.041614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:15.041614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6153c5f4-1f32-4cec-b68f-602e99302f6f tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 404 len: 111 microversion: 2.1 time: 0.033406 Oct 27 13:32:15.041614 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 531/1042] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:15 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:15.045423 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-313706d8-620d-4cf2-a4c6-76fda4c4407d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '.version_select at 0x7fb3734ecc10>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:15.065275 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-313706d8-620d-4cf2-a4c6-76fda4c4407d tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119592942" status: 202 len: 0 microversion: 2.1 time: 0.023497 Oct 27 13:32:15.065844 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 512/1043] 10.222.0.48 () {58 vars in 1221 bytes} [Thu Oct 27 13:32:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1119592942 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:32:16.828121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:16.828763 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:16.835029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:16.836017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:16.836469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:16.837158 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:16.837605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:16.838022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:16.852340 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d HTTP/1.1 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:16.853881 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.855353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '5164aa13-2f80-4ec4-b981-3eafb193fa9d'} Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:16.856102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.857918 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.859323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:16.859323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-832d9222-2810-422c-a85a-e208157ac395 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 404 len: 111 microversion: 2.1 time: 0.031024 Oct 27 13:32:16.859323 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 532/1044] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:32:16 2022] DELETE /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:16.864730 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:16.865349 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 5164aa13-2f80-4ec4-b981-3eafb193fa9d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:16.872218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:16.872724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:16.873154 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:16.873841 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:16.874286 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:16.874705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:16.890763 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d HTTP/1.1 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:32:16.892330 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.893887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '5164aa13-2f80-4ec4-b981-3eafb193fa9d'} Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:16.894761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. Oct 27 13:32:16.896223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:16.897554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 5164aa13-2f80-4ec4-b981-3eafb193fa9d could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:16.897554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c4b60ba4-15b3-4b8d-ba08-c22aebc7289e tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d" status: 404 len: 111 microversion: 2.1 time: 0.033644 Oct 27 13:32:16.897554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 513/1045] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:16 2022] GET /compute/v2.1/servers/5164aa13-2f80-4ec4-b981-3eafb193fa9d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:18.055155 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:18.055665 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:18.061929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.062410 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.062845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.063541 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.063992 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.064480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.078191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 HTTP/1.1 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:18.079805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.081483 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '11301098-003d-44b8-8e75-36876f5a5a37'} Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:18.082329 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.083857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.085923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:18.085923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2a2bb0f0-54d8-4948-a44a-d64038e1fa53 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 404 len: 111 microversion: 2.1 time: 0.030109 Oct 27 13:32:18.085923 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 533/1046] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:32:18 2022] DELETE /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:18.090546 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:18.091174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 11301098-003d-44b8-8e75-36876f5a5a37] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:18.097657 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.098138 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.098571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.099266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.099727 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.100151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.113994 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 HTTP/1.1 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:32:18.115539 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.117160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '11301098-003d-44b8-8e75-36876f5a5a37'} Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:18.121357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. Oct 27 13:32:18.122910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.124205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 11301098-003d-44b8-8e75-36876f5a5a37 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:18.124205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dcb7c58c-3272-4d4c-878f-de9586967dd6 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37" status: 404 len: 111 microversion: 2.1 time: 0.030258 Oct 27 13:32:18.124205 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 514/1047] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:18 2022] GET /compute/v2.1/servers/11301098-003d-44b8-8e75-36876f5a5a37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:18.125730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:18.126230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:18.132183 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.132706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.133154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.133855 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.134314 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.134752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.148636 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 HTTP/1.1 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:18.150181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.151746 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '28008920-1a00-44c9-9036-ef5c8cde50c2'} Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:18.152587 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.154200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.155731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:18.155731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d627942b-a601-4c41-8759-a1c7e91f8973 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 404 len: 111 microversion: 2.1 time: 0.029692 Oct 27 13:32:18.155731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 534/1048] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:32:18 2022] DELETE /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 27 13:32:18.159991 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:18.160705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 28008920-1a00-44c9-9036-ef5c8cde50c2] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:18.167617 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.168105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.168567 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.169265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:18.169716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:18.170136 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:18.183676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 HTTP/1.1 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:32:18.185230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.187636 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '28008920-1a00-44c9-9036-ef5c8cde50c2'} Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:18.188418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. Oct 27 13:32:18.189656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:18.191095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 28008920-1a00-44c9-9036-ef5c8cde50c2 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:18.191095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3d6f1d14-894c-4ea2-bcf6-047b529412f1 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2" status: 404 len: 111 microversion: 2.1 time: 0.030416 Oct 27 13:32:18.191095 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 515/1049] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:18 2022] GET /compute/v2.1/servers/28008920-1a00-44c9-9036-ef5c8cde50c2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:19.332072 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:19.332632 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:19.338868 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:19.339350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:19.339785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:19.340505 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:19.340953 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:19.341380 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:19.355598 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 HTTP/1.1 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:19.357163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.358739 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '7e8b8230-922c-4d41-90e1-6b62526afc91'} Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:19.359578 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.361097 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.362804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:19.362804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e320c937-8267-4526-b565-d75ba7d16b13 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 404 len: 111 microversion: 2.1 time: 0.030267 Oct 27 13:32:19.362804 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 535/1050] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:32:19 2022] DELETE /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:19.367949 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:19.368591 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] [instance: 7e8b8230-922c-4d41-90e1-6b62526afc91] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:32:19.375440 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:19.375932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:19.376418 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:19.377115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:32:19.377554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:32:19.377976 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:32:19.401212 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] HTTP exception thrown: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Request method failure captured: Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 HTTP/1.1 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoa_HV0Ht__cM3QqdQicSUVp9VuuVe4_hDaIQXDFU5_1o1hB5lxncdH9cJ7P3oceetfwG_HYCj-1rrQA2yFWBVHyrDhxFuUrv_JPKXIUuSIZgIwb748Hi38VeoYAkDAwjpplo0ZyhJ3muFoa95vzPx9l5WbWK4J16qQMnoe5yQxQLdc Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:32:19.402838 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_095dae174c664eafaf3ed463d8b7f319"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: 095dae174c664eafaf3ed463d8b7f319 Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1524628936 Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a385ba4ea6ee4a2fa76f0f12719427ee Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-AttachVolumeNegativeTest-1524628936-project Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.404436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '7e8b8230-922c-4d41-90e1-6b62526afc91'} Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:19.405341 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. Oct 27 13:32:19.406631 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:32:19.407747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] Returning 404 to user: Instance 7e8b8230-922c-4d41-90e1-6b62526afc91 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:19.407747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dcc214f6-b8b1-4bea-accb-df1378159389 tempest-AttachVolumeNegativeTest-1524628936 tempest-AttachVolumeNegativeTest-1524628936-project] 10.222.0.48 "GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91" status: 404 len: 111 microversion: 2.1 time: 0.040856 Oct 27 13:32:19.407747 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 516/1051] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:32:19 2022] GET /compute/v2.1/servers/7e8b8230-922c-4d41-90e1-6b62526afc91 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:24.171717 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-74d16b2e-dba4-4fa9-b004-b7c26e29a169 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Action: 'create', calling method: .version_select at 0x7fb373311dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-409681534", "metadata": {"Type": "work"}}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:32:24.469785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-74d16b2e-dba4-4fa9-b004-b7c26e29a169 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.409045 Oct 27 13:32:24.470420 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 536/1052] 10.222.0.48 () {60 vars in 1156 bytes} [Thu Oct 27 13:32:24 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 410 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 27 13:32:24.483411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ef0fbc00-f065-4d3b-a78a-4dd7e6c33425 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb37349ed30>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:24.534427 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ef0fbc00-f065-4d3b-a78a-4dd7e6c33425 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 200 len: 352 microversion: 2.1 time: 0.054850 Oct 27 13:32:24.534998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 517/1053] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:24 2022] GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:25.549548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a52f1758-b25b-4dad-b427-dd8e4c4584b7 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb37331ba60>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:25.598805 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a52f1758-b25b-4dad-b427-dd8e4c4584b7 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 200 len: 353 microversion: 2.1 time: 0.053797 Oct 27 13:32:25.599373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 537/1054] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:25 2022] GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:25.613560 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6564a25d-59ca-4bfb-b7c8-7db3f417ba5e tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb3736c95e0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:25.660102 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6564a25d-59ca-4bfb-b7c8-7db3f417ba5e tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 200 len: 353 microversion: 2.1 time: 0.051168 Oct 27 13:32:25.660728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 518/1055] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:25 2022] GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:25.674453 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bc960af0-059e-4187-9248-02a24caaa089 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb37331b940>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:25.735565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bc960af0-059e-4187-9248-02a24caaa089 tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "DELETE /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 202 len: 0 microversion: 2.1 time: 0.064812 Oct 27 13:32:25.736289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 538/1056] 10.222.0.48 () {58 vars in 1248 bytes} [Thu Oct 27 13:32:25 2022] DELETE /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:32:25.745364 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-1c0c841b-ede8-4a50-8aec-b17e8e1dce7d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb3734ecf70>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:25.797770 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-1c0c841b-ede8-4a50-8aec-b17e8e1dce7d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 200 len: 352 microversion: 2.1 time: 0.056336 Oct 27 13:32:25.798339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 519/1057] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:25 2022] GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 352 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:26.812052 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-83b53f52-ff76-48dd-bb3e-0c0add72d62d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Calling method '.version_select at 0x7fb37338e3a0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:26.841652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-83b53f52-ff76-48dd-bb3e-0c0add72d62d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] HTTP exception thrown: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-83b53f52-ff76-48dd-bb3e-0c0add72d62d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Request method failure captured: Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 HTTP/1.1 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWohnT6FM0wQmnVAdWjgkasadWTp0AaC_To0CliYDVMXaOYcv6pyc5Ti8z2HE7hndAY-ovA1Q_n5xuKRiaH5IJzOAw-0Fgh8lXmPNiR0AnYygSXNPq8prcKO23mHll-VzqVT6DMFLyZ6lmMWCQ-RP5x5WnLCkDXz41XgQ118bU3I1Ow4 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: 4f491056927b46d7844843a6b9c9390d Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-VolumesGetTestJSON-706240675 Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:32:26.843643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/4f491056927b46d7844843a6b9c9390d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f491056927b46d7844843a6b9c9390d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/4f491056927b46d7844843a6b9c9390d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_4f491056927b46d7844843a6b9c9390d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-VolumesGetTestJSON-706240675 Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: 4f491056927b46d7844843a6b9c9390d Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-VolumesGetTestJSON-706240675 Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-VolumesGetTestJSON-706240675-project Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: 6956c2ac2e1b4cf695af79d1d973cc77 Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-VolumesGetTestJSON-706240675-project Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '32819826-1a2f-4247-8cf7-1780b3e8cde7'} Oct 27 13:32:26.845472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. (HTTP 404) (Request-ID: req-efbfd0ff-dbd7-427c-92b0-3445f58aebc9) Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:26.846641 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 27 13:32:26.847883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 27 13:32:26.849171 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-83b53f52-ff76-48dd-bb3e-0c0add72d62d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] Returning 404 to user: Volume 32819826-1a2f-4247-8cf7-1780b3e8cde7 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-83b53f52-ff76-48dd-bb3e-0c0add72d62d tempest-VolumesGetTestJSON-706240675 tempest-VolumesGetTestJSON-706240675-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7" status: 404 len: 109 microversion: 2.1 time: 0.037349 Oct 27 13:32:26.850669 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 539/1058] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:26 2022] GET /compute/v2.1/os-volumes/32819826-1a2f-4247-8cf7-1780b3e8cde7 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:32:29.917833 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:29.919057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:29.923389 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-04a17506-cb53-4976-8034-fc376125bdf6 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb3733a8430>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:29.973885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-04a17506-cb53-4976-8034-fc376125bdf6 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/7338b3c5-85d4-4cf6-881e-c92366f553d1" status: 200 len: 350 microversion: 2.1 time: 0.057234 Oct 27 13:32:29.974466 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 520/1059] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:29 2022] GET /compute/v2.1/os-volumes/7338b3c5-85d4-4cf6-881e-c92366f553d1 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:31.323647 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:31.324584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:32:31.329161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ceda819a-b8d8-4cc3-a738-449db71eaf4a tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb373341790>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:31.380877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ceda819a-b8d8-4cc3-a738-449db71eaf4a tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/4aaf515c-d22a-40e5-a88c-69c7d2384537" status: 200 len: 351 microversion: 2.1 time: 0.058932 Oct 27 13:32:31.381531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 540/1060] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:31 2022] GET /compute/v2.1/os-volumes/4aaf515c-d22a-40e5-a88c-69c7d2384537 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:32.804724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-971863cc-9bb1-45c9-9974-f42fbd661f34 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb37349e8b0>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:32.853501 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-971863cc-9bb1-45c9-9974-f42fbd661f34 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/e5fad5fa-378b-4d24-a2d4-3ff419ab9714" status: 200 len: 351 microversion: 2.1 time: 0.054474 Oct 27 13:32:32.854078 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 521/1061] 10.222.0.48 () {58 vars in 1245 bytes} [Thu Oct 27 13:32:32 2022] GET /compute/v2.1/os-volumes/e5fad5fa-378b-4d24-a2d4-3ff419ab9714 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:32.868443 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-bb33051d-566c-43d3-8cc6-87cdf807c5c1 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb37331b430>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:32.952840 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-bb33051d-566c-43d3-8cc6-87cdf807c5c1 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.089035 Oct 27 13:32:32.953563 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 541/1062] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Oct 27 13:32:32 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:32:32.970959 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3ef617ca-0e23-49b6-b120-f87b4b5b8a36 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb376df8c10>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.068755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3ef617ca-0e23-49b6-b120-f87b4b5b8a36 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102029 Oct 27 13:32:33.069492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 522/1063] 10.222.0.48 () {58 vars in 1149 bytes} [Thu Oct 27 13:32:32 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:33.085226 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-75ab190a-a3be-4561-b202-86be57837e76 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb373306ca0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.175964 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-75ab190a-a3be-4561-b202-86be57837e76 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.094961 Oct 27 13:32:33.176657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 542/1064] 10.222.0.48 () {58 vars in 1134 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:32:33.195438 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c8311a90-1557-415e-823a-e7cb5f457c9f tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb37353b310>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.292933 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c8311a90-1557-415e-823a-e7cb5f457c9f tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.102704 Oct 27 13:32:33.293556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 523/1065] 10.222.0.48 () {58 vars in 1167 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:33.307834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-58f09449-6b38-450d-b167-3db60f9921d7 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb373306670>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.395034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-58f09449-6b38-450d-b167-3db60f9921d7 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091171 Oct 27 13:32:33.395605 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 543/1066] 10.222.0.48 () {58 vars in 1170 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:33.409856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ac4930e8-3d1d-4c08-8ac1-d351eaecce81 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb37349ed30>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.490724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ac4930e8-3d1d-4c08-8ac1-d351eaecce81 tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084605 Oct 27 13:32:33.491295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 524/1067] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:32:33.504749 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cf2c07e9-e598-41b1-9d74-dba9d797e44c tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb37331b940>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.587343 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cf2c07e9-e598-41b1-9d74-dba9d797e44c tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086250 Oct 27 13:32:33.588006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 544/1068] 10.222.0.48 () {58 vars in 1188 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:32:33.602038 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-486a3d63-4fbd-4468-badf-6e33e7c75c3d tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] Calling method '.version_select at 0x7fb376e06040>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:32:33.688888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-486a3d63-4fbd-4468-badf-6e33e7c75c3d tempest-VolumesTestJSON-348514453 tempest-VolumesTestJSON-348514453-project] 10.222.0.48 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.090585 Oct 27 13:32:33.689449 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 525/1069] 10.222.0.48 () {58 vars in 1155 bytes} [Thu Oct 27 13:32:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:13.622258 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4dfa57fc-b97b-4d5f-b668-b9bf22f0b873 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Action: 'create', calling method: .version_select at 0x7fb37335a1f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2049120547", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDuGJX2igmv6eQgRXrDEvmrXwsonNJ/qRIaV2T2ZoawCYM7OicjCyj6jIRCSfYCwy32PaJM/dkS2RW0Eu8tMbHOhPyx6oDivFLyZynSUj/5CEFd/KkUGW6paQbjN/8zY3w=="}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:13.638949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-4dfa57fc-b97b-4d5f-b668-b9bf22f0b873 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Getting quotas for project a470328245084347ac78821d1a0184f7. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:33:13.643312 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-4dfa57fc-b97b-4d5f-b668-b9bf22f0b873 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Getting quotas for user 1d5a8fcbaf9543aca96dea1ce9de3a46 and project a470328245084347ac78821d1a0184f7. Resources: {'key_pairs'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:33:13.665945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4dfa57fc-b97b-4d5f-b668-b9bf22f0b873 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.230499 Oct 27 13:33:13.666545 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 545/1070] 10.222.0.48 () {60 vars in 1159 bytes} [Thu Oct 27 13:33:13 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:33:29.232529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-950679288", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2049120547", "security_groups": [{"name": "tempest-secgroup-smoke-1302466109"}], "networks": [{"uuid": "d729aa6a-21f7-47de-a278-a508b8293cf2"}], "block_device_mapping_v2": [{"uuid": "0d639095-2502-4aca-80d1-1bcdd53dab8b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:29.346035 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] validate_networks() for [('d729aa6a-21f7-47de-a278-a508b8293cf2', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:33:29.980633 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:33:29.981065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:33:29.981533 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:33:29.981937 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:33:29.982345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:33:29.992692 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:29.993426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:29.993856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:29.994577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:29.995028 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:29.995450 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:30.013429 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Getting quotas for project a470328245084347ac78821d1a0184f7. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:33:30.023275 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Getting quotas for user 1d5a8fcbaf9543aca96dea1ce9de3a46 and project a470328245084347ac78821d1a0184f7. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:33:30.080953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:33:30.083175 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0d639095-2502-4aca-80d1-1bcdd53dab8b',volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:33:30.209818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0571ad7d-6526-4117-ac43-c9d0f30c2745 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.982928 Oct 27 13:33:30.210464 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 526/1071] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:33:29 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:33:30.218947 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=4 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:30.219711 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:30.224680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-81c864af-05ed-4668-9ebe-5dd90f7a0513 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:30.225550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-81c864af-05ed-4668-9ebe-5dd90f7a0513 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:30.280785 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-81c864af-05ed-4668-9ebe-5dd90f7a0513 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:30.288399 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-81c864af-05ed-4668-9ebe-5dd90f7a0513 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1088 microversion: 2.1 time: 0.070699 Oct 27 13:33:30.288955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 546/1072] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:30 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1088 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:33:31.311277 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c32843ef-0a03-4873-8b0e-603c124a9d43 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:31.312036 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c32843ef-0a03-4873-8b0e-603c124a9d43 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:31.366664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c32843ef-0a03-4873-8b0e-603c124a9d43 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:31.373777 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c32843ef-0a03-4873-8b0e-603c124a9d43 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1088 microversion: 2.1 time: 0.067029 Oct 27 13:33:31.374335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 527/1073] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:31 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:32.004551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:32.005081 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:32.011946 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:32.012456 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:32.012893 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:32.013582 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:32.014033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:32.014457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:32.038691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:33:32.110403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-98aeacd5-bff4-4c71-93f3-65a92e5be948 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "DELETE /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 204 len: 0 microversion: 2.1 time: 0.110131 Oct 27 13:33:32.111411 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 547/1074] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:33:31 2022] DELETE /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:33:32.120155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:32.120859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:32.127706 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:32.128200 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:32.128656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:32.129357 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:32.129808 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:32.130231 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:32.263241 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:32.270926 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-45d93a1b-c828-4038-b52b-811617a35116 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1572 microversion: 2.1 time: 0.155526 Oct 27 13:33:32.271486 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 528/1075] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:32 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1572 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:32.397735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b39b639b-dd59-45c1-b6cb-069699791bce tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:32.398440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b39b639b-dd59-45c1-b6cb-069699791bce tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:32.455148 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b39b639b-dd59-45c1-b6cb-069699791bce tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:32.462756 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b39b639b-dd59-45c1-b6cb-069699791bce tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1088 microversion: 2.1 time: 0.069563 Oct 27 13:33:32.463361 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 548/1076] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:32 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1088 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:33.302257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:33.302872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:33.309455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:33.309967 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:33.310422 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:33.311139 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:33.311679 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:33.312101 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:33.443910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:33.451646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3095cc39-33d3-433e-b1b8-55e9c374d92a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1572 microversion: 2.1 time: 0.153925 Oct 27 13:33:33.452216 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 529/1077] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:33 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1572 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:33.485230 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f9ec0c19-bc39-48b3-a334-3100fe873a29 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:33.486487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f9ec0c19-bc39-48b3-a334-3100fe873a29 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:33.546857 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f9ec0c19-bc39-48b3-a334-3100fe873a29 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:33.555185 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f9ec0c19-bc39-48b3-a334-3100fe873a29 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1088 microversion: 2.1 time: 0.074551 Oct 27 13:33:33.555948 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 549/1078] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:33 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1088 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:34.466347 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14588610-98fd-455b-9380-16dbcd733d9f", "name": "network-vif-deleted", "tag": "6f0a58f6-2585-493b-a27f-602a89862c6f"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:34.475252 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:34.478762 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:34.479244 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:34.479669 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:34.486920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:34.494105 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:34.495033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:34.495203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] Creating event network-vif-deleted:6f0a58f6-2585-493b-a27f-602a89862c6f for instance 14588610-98fd-455b-9380-16dbcd733d9f on hv-cinder-86243 Oct 27 13:33:34.495743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:34.496791 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:34.497436 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:34.498123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:34.500909 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-c99beb4a-4045-455b-aa36-ff362fea05c9 req-26748134-7d81-453e-b8f5-22d218f56169 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038276 Oct 27 13:33:34.505249 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 530/1079] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:33:34.578353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:34.580796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:34.589607 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:34.590563 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:34.591155 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:34.592639 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:34.593295 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:34.594135 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:34.601682 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:34.610492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-eb2f6fc9-e2c7-4865-af7f-ad6ab4620ed9 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1507 microversion: 2.1 time: 0.139136 Oct 27 13:33:34.616341 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 550/1080] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:34 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1507 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:34.679506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:34.689647 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bbde2544-0017-4689-a34f-93476522a69f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1138 microversion: 2.1 time: 0.116037 Oct 27 13:33:34.690336 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 531/1081] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:34 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1138 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:33:35.634998 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:35.636534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:35.645394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:35.646227 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:35.646905 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:35.647849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:35.648754 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:35.649472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:35.692702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:35.693197 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:35.693824 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:35.694291 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lazy-loading 'fault' on Instance uuid 14588610-98fd-455b-9380-16dbcd733d9f {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:33:35.714806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:35.716019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:35.723787 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:35.724416 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:35.724825 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:35.725504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:35.726226 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:35.726650 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:35.754545 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:35.761802 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-fe017553-ae4a-4660-bf34-c0ee0c671f62 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 200 len: 1183 microversion: 2.1 time: 0.130688 Oct 27 13:33:35.762471 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 551/1082] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:35 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 1183 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:35.800799 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:35.808365 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-152c7eae-bbbd-44c0-bc72-c28e516d471e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1204 microversion: 2.1 time: 0.098298 Oct 27 13:33:35.812273 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 532/1083] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:35 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1204 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:33:36.784732 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:36.785355 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:36.791492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:36.791974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:36.792448 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:36.793139 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:36.793588 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:36.794050 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:36.808188 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] HTTP exception thrown: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Request method failure captured: Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f HTTP/1.1 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofuBNno0SwerIiV8UQfrz1XBCn_LlQey4V-RFEDLLW7P3On273Ec2eac9t3G3gk7GGjcP0hlX8SjgShrr0Uh1yjPKXEGsnI7ILGvbGrn2ONussnwTezbRSjcRonzo55PlN7yrIIu_zdrwbWO7XMnqnaggZbO6uHT25ru8hxf4oSN7k Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:33:36.809886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a41fc97ca6ea4a1c8201f068b26e6888 Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:33:36.811569 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '14588610-98fd-455b-9380-16dbcd733d9f'} Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:33:36.812544 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:33:36.814591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:33:36.815932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Returning 404 to user: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:33:36.815932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-7361b19b-a0fb-4381-8776-abf4a9a390a1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 404 len: 111 microversion: 2.1 time: 0.030526 Oct 27 13:33:36.815932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 552/1084] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:36 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:33:36.830882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:36.832074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:36.839956 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:36.841177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:36.841805 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:36.843173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:36.843802 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:36.844846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:36.923689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:36.936010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:36.937086 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:36.937528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:36.951444 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] Creating event network-changed:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:33:36.956490 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-a3da2324-bde1-49e7-bf2e-83d37cda1096 req-b70de5a4-f3f3-40ed-9b1b-fe8ecbf95556 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042148 Oct 27 13:33:36.957584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 553/1085] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:33:36.963560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-92351773", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-936264149", "security_groups": [{"name": "tempest-secgroup-smoke-1629517"}], "block_device_mapping_v2": [{"uuid": "3c0f869b-4c39-4ae6-a6fd-39e4c48bf69b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c8f3dd5-6b59-4fe5-89a4-312211a0043d"}]}} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:36.992978 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:37.001977 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9d1158e6-39a8-47ca-a98a-ae39bb91e2c3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.174445 Oct 27 13:33:37.002545 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 533/1086] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:36 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:37.121024 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.network.neutron [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] validate_networks() for [('1c8f3dd5-6b59-4fe5-89a4-312211a0043d', None, None, None, None, None)] {{(pid=118773) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:33:37.653803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:33:37.654233 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image limits 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:33:37.654707 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:33:37.655119 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image pref 0:0:0 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:33:37.655560 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.virt.hardware [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118773) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:33:37.664955 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:37.665469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:37.665911 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:37.666643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:37.667101 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:37.667528 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:37.683949 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:33:37.687882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.quota [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for user a41fc97ca6ea4a1c8201f068b26e6888 and project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118773) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:33:37.748089 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Going to run 1 instances... {{(pid=118773) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:33:37.750404 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3c0f869b-4c39-4ae6-a6fd-39e4c48bf69b',volume_size=None,volume_type=None)] {{(pid=118773) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:33:37.883596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f9ffbe23-7fb5-4f7e-be9b-2a3e1efbb481 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.924210 Oct 27 13:33:37.884300 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 554/1087] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:33:36 2022] POST /compute/v2.1/servers => generated 403 bytes in 926 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:33:37.896528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9ff69d73-fecc-4710-9326-ce090a4ce9e7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:37.897506 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9ff69d73-fecc-4710-9326-ce090a4ce9e7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:37.966796 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9ff69d73-fecc-4710-9326-ce090a4ce9e7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:37.974124 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9ff69d73-fecc-4710-9326-ce090a4ce9e7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1092 microversion: 2.1 time: 0.082234 Oct 27 13:33:37.974888 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 534/1088] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:37 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1092 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:38.028962 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:38.029657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:38.037303 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:38.037921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:38.038423 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:38.039373 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:38.039893 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:38.040413 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:38.254899 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:38.271005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0095b3cf-dbeb-4a32-a79d-875ccd5bf610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.247490 Oct 27 13:33:38.286200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 555/1089] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:38 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:38.997346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:38.998031 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:39.004918 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:39.005220 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:39.005664 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:39.006367 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:39.007066 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:39.007242 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:39.081339 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:39.090755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-0ee1395a-290c-4f4a-a7a7-83afb280aa9e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1208 microversion: 2.1 time: 0.097348 Oct 27 13:33:39.091335 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 535/1090] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:38 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1208 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:39.294236 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:39.294864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:39.301215 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:39.301747 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:39.302205 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:39.303029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:39.303492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:39.303917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:39.543441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:39.551125 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ca73637d-cc1f-4180-892f-60a26dfbc363 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.260979 Oct 27 13:33:39.551920 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 556/1091] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:39 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:40.115133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:40.115998 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:40.118353 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:40.124197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:40.124716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:40.125152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:40.125882 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:40.126797 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:40.127312 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:40.261098 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:40.268839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2a61a44a-5e6d-4d38-a828-5d9792c3d132 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.158205 Oct 27 13:33:40.269426 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 536/1092] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:40 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:40.574191 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:40.574893 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:40.581965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:40.582518 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:40.583019 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:40.583771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:40.584223 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:40.584662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:40.627646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12651cd4-4b20-496e-aa7e-a7c4bb660d60", "tag": "345f34ea-234b-441c-abfc-59215677d45d"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:40.640140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:40.640674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:40.641114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:40.654050 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] Creating event network-changed:345f34ea-234b-441c-abfc-59215677d45d for instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 on hv-cinder-86243 Oct 27 13:33:40.659798 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-2e049e1b-726d-407c-b66c-51b6f90807cc req-7aee341d-9b93-46f8-9bf3-49aa1be6a5d5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037065 Oct 27 13:33:40.660578 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 537/1093] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:33:40.855045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:40.862875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0623fce8-0e1e-48e1-9a48-c870bdf63707 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.292697 Oct 27 13:33:40.863494 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 557/1094] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:40 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:41.293158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:41.293781 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:41.300695 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:41.301186 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:41.301620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:41.302323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:41.302779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:41.303204 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:41.434453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:41.443151 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-8e9bdf26-adec-4582-a2ba-f6eb565adde0 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.154341 Oct 27 13:33:41.443736 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 538/1095] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:41 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:41.885925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:41.886549 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:41.892982 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:41.893469 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:41.893904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:41.894595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:41.895044 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:41.895465 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:42.024367 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:42.032676 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4edf32a6-dd48-4849-a918-b64a2915e787 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.149958 Oct 27 13:33:42.033245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 558/1096] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:41 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:42.465556 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:42.466174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:42.472637 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:42.473118 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:42.473551 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:42.474236 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:42.474688 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:42.475109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:42.611524 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:42.619624 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bfdb5476-aeaa-46b1-a197-28a6cee6a9ee tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.157949 Oct 27 13:33:42.620197 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 539/1097] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:42 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:43.054975 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:43.055616 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:43.062056 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:43.062534 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:43.062965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:43.064306 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:43.064759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:43.065180 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:43.197388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:43.205131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b4f5bddb-02a4-44c7-8ad3-a36d5bb712fb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.154012 Oct 27 13:33:43.205694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 559/1098] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:43 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:43.642878 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:43.643504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:43.649922 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:43.650411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:43.650854 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:43.651552 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:43.652010 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:43.652469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:43.784309 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:43.791842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-83b0bde0-b43e-4018-be26-df5065fc328b tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.153776 Oct 27 13:33:43.792559 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 540/1099] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:43 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:44.227898 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:44.228570 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:44.235467 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:44.235959 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:44.236428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:44.237130 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:44.237594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:44.238023 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:44.381457 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:44.389377 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-f257d120-e677-4334-a6bb-77c67bf13cff tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.165334 Oct 27 13:33:44.390009 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 560/1100] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:44 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:44.813462 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:44.814081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:44.820492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:44.820983 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:44.821425 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:44.822123 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:44.822577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:44.823006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:44.956344 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:44.963943 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-d86d8e4a-a6f1-415e-907e-f32f6c27186e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.154351 Oct 27 13:33:44.964853 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 541/1101] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:44 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:45.412192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:45.412954 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:45.419403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:45.419877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:45.420459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:45.421153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:45.421604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:45.422028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:45.552181 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:45.559778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-8e5624de-39f3-423b-aca9-81df54a09300 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.151422 Oct 27 13:33:45.560428 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 561/1102] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:45 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:45.988004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:45.988648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:45.995367 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:45.995848 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:45.996310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:45.996997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:45.997448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:45.997872 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:46.127514 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:46.135152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9ef7a4c1-6c06-467f-9a49-96e890316d20 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.151056 Oct 27 13:33:46.135711 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 542/1103] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:45 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:46.583622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:46.584437 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:46.590871 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:46.591368 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:46.591814 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:46.592554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:46.593112 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:46.593440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:46.681772 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "name": "network-vif-plugged", "status": "completed", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:46.694599 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:46.695057 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:46.695485 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:46.708152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] Creating event network-vif-plugged:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:33:46.713914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-e64bb64c-2596-4e7e-b14e-08850b8d35c4 req-31f8193b-c87a-4319-bcde-632e8d30556e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035964 Oct 27 13:33:46.714710 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 543/1104] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:33:46.737889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:46.746010 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-02d8dde5-f163-4897-85ac-33e286cb2957 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.166937 Oct 27 13:33:46.746594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 562/1105] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:46 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:47.160393 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:47.161116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:47.167691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:47.168184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:47.168660 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:47.169372 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:47.169829 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:47.170257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:47.311963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:47.319678 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-87956759-7ef4-4f51-9c00-ec2445c63dbc tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.164641 Oct 27 13:33:47.320255 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 544/1106] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:47 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:47.770245 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:47.770874 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:47.773438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:47.774102 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=12 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:47.780480 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:47.780970 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:47.781481 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:47.782192 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:47.782644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:47.783064 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:47.933628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:47.942725 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-6b585b8d-03d0-4aff-bb10-05bbb6b3a610 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1260 microversion: 2.1 time: 0.176947 Oct 27 13:33:47.943366 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 563/1107] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:47 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:48.342914 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:48.343603 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:48.346281 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=10 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:48.353141 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:48.354041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:48.354041 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:48.354779 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:48.355230 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:48.355652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:48.497970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:48.506712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-7dbacfe0-218a-49b6-8a1a-c1caf2724165 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.167752 Oct 27 13:33:48.507325 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 545/1108] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:48 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:48.967035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:48.967662 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:48.975651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:48.976142 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:48.976897 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:48.977712 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:48.978166 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:48.978594 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:49.134395 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:49.143748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2b2b785d-55f3-43ce-aafc-ba78896cd350 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1444 microversion: 2.1 time: 0.180918 Oct 27 13:33:49.144353 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 564/1109] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:48 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1444 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:49.171245 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:49.172563 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:49.183483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:49.184455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:49.185290 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:49.186634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:49.187520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:49.188919 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:49.334791 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:49.342716 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6077ddb8-e3fe-4700-8573-1d4e20fff5fd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1444 microversion: 2.1 time: 0.179079 Oct 27 13:33:49.343299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 546/1110] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:49 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1444 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:49.530289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:49.530983 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:49.537593 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:49.538133 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:49.538646 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:49.539389 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:49.539848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:49.540597 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:49.559633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:49.681540 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:49.690029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a3f6c3f8-f9ce-4fb3-948d-44e183a22ee1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.164235 Oct 27 13:33:49.690595 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 565/1111] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:49 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:50.712997 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:50.714253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:50.721611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:50.722435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:50.722875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:50.723604 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:50.724067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:50.724525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:50.729299 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=100 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:33:50.850845 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12651cd4-4b20-496e-aa7e-a7c4bb660d60", "name": "network-vif-plugged", "status": "completed", "tag": "345f34ea-234b-441c-abfc-59215677d45d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:50.865800 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:50.867438 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:50.869344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:50.889513 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] Creating event network-vif-plugged:345f34ea-234b-441c-abfc-59215677d45d for instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 on hv-cinder-86243 Oct 27 13:33:50.898759 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-10a6e955-deef-4a6a-bd65-9abaf30aaf89 req-cc19592b-b9de-4068-a3f4-0efe487ad0d3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052878 Oct 27 13:33:50.900511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 566/1112] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:33:51.099114 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:51.107117 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-e674cce9-3b2a-4b64-ac8d-899384e17214 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.397971 Oct 27 13:33:51.107695 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 547/1113] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:50 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:33:51.212586 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:51.223681 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:51.224199 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:51.224879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:51.236593 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] Creating event network-changed:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:33:51.242022 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-483781b1-d093-4eab-a568-7d1e611124e2 req-5cf45fbb-d2a2-4b9a-8e68-9dfef42ae079 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035934 Oct 27 13:33:51.242885 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 567/1114] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:33:52.134503 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:52.135131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:52.142267 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:52.142902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:52.143345 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:52.144056 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:52.144536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:52.144968 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:52.290023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:52.298282 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-dcc0f7d8-c283-4f7c-9e18-7096de109c21 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1261 microversion: 2.1 time: 0.167738 Oct 27 13:33:52.298862 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 548/1115] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:52 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:53.322242 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:53.322951 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:53.329200 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:53.329683 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:53.330121 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:53.330816 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:53.331271 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:53.331693 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:53.515293 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:53.523017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-9557b1a4-4848-4057-9f9f-5152d57a5eda tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1448 microversion: 2.1 time: 0.205545 Oct 27 13:33:53.523584 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 568/1116] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:53 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1448 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:53.544781 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:33:53.545402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:33:53.552571 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:53.553058 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:53.553493 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:53.554188 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:53.554643 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:53.555070 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:53.687401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:33:53.695177 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-ce461841-85eb-46e0-871b-18db0d4ba8ec tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1448 microversion: 2.1 time: 0.154298 Oct 27 13:33:53.695750 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 549/1117] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:33:53 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1448 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:33:55.357882 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12651cd4-4b20-496e-aa7e-a7c4bb660d60", "tag": "345f34ea-234b-441c-abfc-59215677d45d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:33:55.368680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:33:55.369161 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:33:55.369596 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:33:55.380825 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] Creating event network-changed:345f34ea-234b-441c-abfc-59215677d45d for instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 on hv-cinder-86243 Oct 27 13:33:55.386033 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-73a82294-9554-4fd6-b552-3fa9736bbf82 req-de87b462-a563-44d6-ba0c-4cd0de38b559 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032039 Oct 27 13:33:55.386929 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 569/1118] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:35:41.363456 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:41.364203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=16 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:41.365401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 27 13:35:41.365569 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Thu Oct 27 13:35:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.48) !!! Oct 27 13:35:41.371495 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-791355503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-936264149", "security_groups": [{"name": "tempest-secgroup-smoke-1629517"}], "block_device_mapping_v2": [{"uuid": "ca904b07-4701-439e-abaa-bc8ca8ec5d2f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c8f3dd5-6b59-4fe5-89a4-312211a0043d"}]}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:35:41.486885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.network.neutron [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] validate_networks() for [('1c8f3dd5-6b59-4fe5-89a4-312211a0043d', None, None, None, None, None)] {{(pid=118774) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 27 13:35:42.150182 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 27 13:35:42.150601 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image limits 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 27 13:35:42.151072 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Flavor pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 27 13:35:42.151508 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Image pref 0:0:0 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 27 13:35:42.151923 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.virt.hardware [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118774) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 27 13:35:42.160615 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:42.161093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:42.161525 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:42.162248 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:42.162699 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:42.163121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:42.179329 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 27 13:35:42.183806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.quota [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Getting quotas for user a41fc97ca6ea4a1c8201f068b26e6888 and project f291a3a8c0394e928aee758baa470ca7. Resources: {'cores', 'ram', 'instances'} {{(pid=118774) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 27 13:35:42.239970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Going to run 1 instances... {{(pid=118774) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 27 13:35:42.242105 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ca904b07-4701-439e-abaa-bc8ca8ec5d2f',volume_size=None,volume_type=None)] {{(pid=118774) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 27 13:35:42.371528 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9e45e392-32e7-47a5-90e2-92dffe42538a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 1.009708 Oct 27 13:35:42.372257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 550/1119] 10.222.0.48 () {60 vars in 1147 bytes} [Thu Oct 27 13:35:41 2022] POST /compute/v2.1/servers => generated 403 bytes in 1011 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 27 13:35:42.381631 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7cc5fb5f-f025-477e-b501-0971ae5fa3c4] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 13:35:42.382599 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:42.383491 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=14 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:42.385539 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Oct 27 13:35:42.394963 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d3e72579-4a60-4315-a6e8-5391ceca2e16 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:42.395691 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d3e72579-4a60-4315-a6e8-5391ceca2e16 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:42.453384 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d3e72579-4a60-4315-a6e8-5391ceca2e16 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:42.460140 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d3e72579-4a60-4315-a6e8-5391ceca2e16 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1093 microversion: 2.1 time: 0.080482 Oct 27 13:35:42.460740 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 570/1120] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:42 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:43.483498 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:43.484116 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:43.493828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:43.494265 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:43.494976 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:43.495682 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:43.496129 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:43.496573 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:43.564958 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:43.574863 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-f0da4921-0255-4994-bae3-e822c57b5160 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1199 microversion: 2.1 time: 0.095617 Oct 27 13:35:43.575828 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 551/1121] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:43 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1199 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:44.599350 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:44.599961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:44.614877 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO oslo.messaging._drivers.impl_rabbit [-] [7cc5fb5f-f025-477e-b501-0971ae5fa3c4] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 48098. Oct 27 13:35:44.617768 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:44.618548 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:44.618803 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:44.619924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:44.620401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:44.621394 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:44.824834 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:44.832470 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-65c4b9eb-5147-4398-9db2-11aff9cbb30f tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.237986 Oct 27 13:35:44.833051 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 571/1122] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:44 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:45.271387 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bebfd790-14af-407c-9357-ce102a1ce53d", "tag": "348273cd-f10d-480b-b8b3-9e76b212a7c1"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:35:45.287676 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:45.288149 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:45.288620 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:45.300752 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] Creating event network-changed:348273cd-f10d-480b-b8b3-9e76b212a7c1 for instance bebfd790-14af-407c-9357-ce102a1ce53d on hv-cinder-86243 Oct 27 13:35:45.305821 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-e9e0d2bb-a620-4789-b243-7f6e7080d33b req-81b8c4a3-766e-4811-85d3-0981acd78cb0 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107487 Oct 27 13:35:45.306266 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 552/1123] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:35:45.855869 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:45.856454 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:45.862848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:45.863327 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:45.863792 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:45.864516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:45.864971 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:45.865397 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:46.072131 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:46.079822 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d12d7cc4-38d8-4b72-839e-3cb2091397e1 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.228538 Oct 27 13:35:46.080422 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 572/1124] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:45 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:47.104152 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:47.104846 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:47.111391 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:47.111865 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:47.112327 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:47.113006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:47.113458 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:47.113885 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:47.244701 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:47.253235 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-06341d52-898a-4e20-96fc-1d6f44ae357c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.154036 Oct 27 13:35:47.253795 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 553/1125] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:47 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:48.275243 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:48.275859 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:48.282326 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.282812 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.283246 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.283941 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.284424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.284854 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.302413 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:35:48.303133 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:48.310096 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.310581 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.311173 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.311875 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.312411 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.312839 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.336548 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lazy-loading 'flavor' on Instance uuid f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:35:48.416963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-22940cde-8982-419a-a9c0-11b8a627b6d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "POST /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1/action" status: 202 len: 0 microversion: 2.1 time: 0.118173 Oct 27 13:35:48.417577 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 554/1126] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:35:48 2022] POST /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:35:48.421501 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:48.426015 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:48.426723 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:48.430154 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-04614c26-03a1-420b-aea1-675ed16e2296 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.158721 Oct 27 13:35:48.431024 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 573/1127] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:48 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:48.434261 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.434756 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.435193 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.435896 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:48.436385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:48.436812 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:48.571022 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:48.579291 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-9995b615-cd76-4aed-b7f3-7e636863ee7a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.157319 Oct 27 13:35:48.579856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 555/1128] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:48 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:49.454414 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:49.455029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:49.461405 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:49.461889 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:49.462322 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:49.463017 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:49.463468 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:49.463891 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:49.593163 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:49.601309 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-cd49a745-d3ba-4a21-ba73-1eee07c544fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.150707 Oct 27 13:35:49.601879 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 574/1129] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:49 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:49.602860 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:49.603530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:49.610218 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:49.610698 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:49.611161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:49.611856 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:49.612337 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:49.612755 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:49.743724 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:49.752120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-efdef5b6-40bb-42bf-a241-7d442be06bcd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.153166 Oct 27 13:35:49.752740 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 556/1130] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:49 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:50.624376 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:50.624996 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:50.631289 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:50.631774 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:50.632209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:50.632921 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:50.633379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:50.633806 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:50.766078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:50.775684 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2fcbc182-42ee-4739-ac08-a40d7eb93432 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.155239 Oct 27 13:35:50.776013 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:50.776572 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 575/1131] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:50 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:50.776663 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:50.784174 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:50.784691 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:50.785128 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:50.785859 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:50.786310 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:50.786731 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:50.914734 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:50.922816 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-abca55db-4db6-4838-937c-d3c9303cdb78 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.151141 Oct 27 13:35:50.923377 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 557/1132] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:50 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:51.799660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:51.800338 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:51.806635 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:51.807109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:51.807537 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:51.808222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:51.808695 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:51.809202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:51.937441 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:51.945206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b0ac74d6-a9fb-4a25-9988-0e17ec4efb72 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.150073 Oct 27 13:35:51.945775 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 576/1133] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:51 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:51.946340 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:51.946946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:51.953892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:51.954371 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:51.954800 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:51.955509 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:51.955940 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:51.956386 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:52.088910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:52.097034 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-26c2badc-b714-4368-a379-f0691a219c0f tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.154498 Oct 27 13:35:52.097593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 558/1134] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:51 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:52.969841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:52.970447 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:52.972344 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell0:SELECT=2 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:52.978034 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:52.978522 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:52.978965 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:52.979926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:52.980487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:52.980925 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:53.114138 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:53.120258 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:53.121164 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:53.122407 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-a0fc66bf-5fcf-4786-923e-2e9dfea44bf7 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.157037 Oct 27 13:35:53.122987 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 577/1135] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:52 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:53.123257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=2 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:53.124083 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell0:SELECT=6 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:35:53.129765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:53.130253 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:53.130690 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:53.131384 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:53.131837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:53.132285 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:53.262455 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:53.270115 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-c8cbb13b-b6a4-4149-a38c-f6ac3ccb294b tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.153642 Oct 27 13:35:53.270685 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 559/1136] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:53 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:54.145883 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:54.146497 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:54.152828 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:54.153304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:54.153734 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:54.154415 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:54.155039 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:54.155531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:54.282048 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:54.289721 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ebe4c62d-871b-4d69-8e24-79a83cfa928e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.147707 Oct 27 13:35:54.290273 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 578/1137] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:54 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:54.293964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:54.294580 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:54.301162 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:54.301643 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:54.302080 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:54.302767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:54.303222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:54.303648 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:54.432892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:54.441260 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-051f249b-a91e-4cee-ad78-f6646a5328f1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.151206 Oct 27 13:35:54.441822 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 560/1138] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:54 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:55.312388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:55.313028 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:55.319123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:55.319604 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:55.320035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:55.320823 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:55.321270 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:55.321694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:55.467362 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:55.475565 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-2009dc17-f05d-472f-9dba-5895b90a4771 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.167074 Oct 27 13:35:55.476137 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 579/1139] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:55 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:55.480727 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:55.481516 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:55.487625 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:55.488106 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:55.488571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:55.489263 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:55.489708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:55.490123 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:55.519986 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebfd790-14af-407c-9357-ce102a1ce53d", "name": "network-vif-plugged", "status": "completed", "tag": "348273cd-f10d-480b-b8b3-9e76b212a7c1"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:35:55.532109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:55.532630 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:55.533061 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:55.545946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] Creating event network-vif-plugged:348273cd-f10d-480b-b8b3-9e76b212a7c1 for instance bebfd790-14af-407c-9357-ce102a1ce53d on hv-cinder-86243 Oct 27 13:35:55.550972 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-fb930064-da53-4991-8ff1-a879403a1c3f req-e0bcd6db-3b90-4a73-93ae-015b69778f07 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109128 Oct 27 13:35:55.551634 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 561/1140] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:35:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:35:55.631294 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:55.639902 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-236ae44e-1506-4628-a0a4-090dbee892b5 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.162046 Oct 27 13:35:55.640512 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 580/1141] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:55 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:56.499652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:56.500380 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:56.506934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:56.507409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:56.507842 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:56.508554 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:56.509004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:56.509453 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:56.647013 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:56.654714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-12334902-3b0c-4349-b7bd-44d9d3bb3b86 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1262 microversion: 2.1 time: 0.159791 Oct 27 13:35:56.655284 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 562/1142] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:56 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1262 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:56.662694 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:56.663398 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:56.669875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:56.670360 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:56.671296 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:56.671993 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:56.672487 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:56.672917 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:56.807424 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:56.817680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3fd60cf4-98cb-4d64-b230-2343d4f60de4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.158702 Oct 27 13:35:56.818272 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 581/1143] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:56 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:57.677761 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:57.678379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:57.684837 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.685319 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.685757 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.687055 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.687504 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.687953 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.816614 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:57.824273 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-193db560-9b15-4e32-bf4f-0c899e37ebb2 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1448 microversion: 2.1 time: 0.150428 Oct 27 13:35:57.824840 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 563/1144] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:57 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1448 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:57.840479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:57.841098 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:57.846065 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:57.846674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:57.847680 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.848175 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.848651 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.849506 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.849798 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.850222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.852435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.852913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.853343 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.854030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:57.854705 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:57.855131 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:57.981612 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:57.987517 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:57.990122 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-e7a0fde3-4cfd-4030-969e-8661fa72cd19 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.153454 Oct 27 13:35:57.990708 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 582/1145] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:57 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:57.995184 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a37eb574-af6e-495c-bfbe-795873edd125 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1448 microversion: 2.1 time: 0.152751 Oct 27 13:35:57.995900 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 564/1146] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:57 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1448 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:35:59.013359 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:35:59.014743 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:35:59.021642 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:59.022440 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:59.022968 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:59.023924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:59.024477 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:59.025150 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:59.219813 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:35:59.227590 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0279fb2d-71f0-4940-97f1-ac27c940ab24 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.217960 Oct 27 13:35:59.228168 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 583/1147] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:35:59 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:35:59.657892 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bebfd790-14af-407c-9357-ce102a1ce53d", "tag": "348273cd-f10d-480b-b8b3-9e76b212a7c1"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:35:59.667819 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:35:59.668320 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:35:59.668753 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:35:59.681890 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] Creating event network-changed:348273cd-f10d-480b-b8b3-9e76b212a7c1 for instance bebfd790-14af-407c-9357-ce102a1ce53d on hv-cinder-86243 Oct 27 13:35:59.686969 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-22574cb8-7af8-4580-9234-cd3fe398f652 req-c9028509-1358-4f14-8ba2-bd51a63798ec service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091120 Oct 27 13:35:59.687585 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 565/1148] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:35:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:36:00.251901 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:00.252482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:00.258755 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:00.259231 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:00.259660 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:00.260387 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:00.261014 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:00.261400 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:00.476735 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:00.486164 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-3a182fc4-0444-4fdd-8e5e-7df58cf740cb tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.238955 Oct 27 13:36:00.486752 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 584/1149] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:00 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:01.510961 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:01.511680 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:01.518161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:01.518646 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:01.519077 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:01.519765 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:01.520213 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:01.520666 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:01.656379 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:01.664027 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4a3128bb-3508-4bc9-a29b-3b7c94fa7af4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1569 microversion: 2.1 time: 0.157815 Oct 27 13:36:01.664662 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 566/1150] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:01 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:01.686472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:36:01.687601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:01.694069 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:01.694551 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:01.695018 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:01.695702 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:01.696153 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:01.696730 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:01.725847 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118773) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 27 13:36:01.789976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR oslo.messaging._drivers.impl_rabbit [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [3dcf293d-2520-4491-a543-659f2c3e4646] AMQP server on 10.222.0.48:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 27 13:36:02.797461 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO oslo.messaging._drivers.impl_rabbit [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [3dcf293d-2520-4491-a543-659f2c3e4646] Reconnected to AMQP server on 10.222.0.48:5672 via [amqp] client with port 48170. Oct 27 13:36:02.801029 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-4b7d572a-1ad7-4f3c-99de-ca9a61933bfd tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "POST /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1/action" status: 202 len: 0 microversion: 2.1 time: 1.118488 Oct 27 13:36:02.801642 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 585/1151] 10.222.0.48 () {60 vars in 1278 bytes} [Thu Oct 27 13:36:01 2022] POST /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1/action => generated 0 bytes in 1120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 27 13:36:02.809984 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:02.810597 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:02.817618 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:02.818100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:02.818529 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:02.819221 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:02.819671 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:02.820099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:02.825402 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:36:02.959257 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:02.967240 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-87e15afd-3b41-46a0-b1c4-c366451b7776 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1517 microversion: 2.1 time: 0.161432 Oct 27 13:36:02.968100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 567/1152] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:02 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1517 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:03.999078 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:04.000209 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:04.009404 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:04.009903 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:04.010346 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:04.011063 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:04.011525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:04.011976 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:04.032592 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:36:04.149706 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:04.157571 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-13936f18-fa77-435c-b9e4-a8d7fa5ae2dc tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.163337 Oct 27 13:36:04.158137 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 586/1153] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:03 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:05.181264 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:05.181880 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:05.189107 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:05.189589 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:05.190023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:05.190712 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:05.191165 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:05.191605 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:05.320767 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:05.329656 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-bf4026d0-6da0-43ed-b9ea-de5e1a1900d3 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.152261 Oct 27 13:36:05.330492 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 568/1154] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:05 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:05.420633 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "name": "network-vif-unplugged", "status": "completed", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:36:05.430818 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:05.431349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:05.431788 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:05.443401 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] Creating event network-vif-unplugged:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:36:05.448402 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-59924524-3265-409f-bda0-2dcd2edc5ea8 req-b24a2f1d-d33a-479a-bae6-8dda6b969eff service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031575 Oct 27 13:36:05.449349 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 587/1155] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:36:06.352593 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:06.353211 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:06.359674 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:06.360157 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:06.360628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:06.361323 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:06.361781 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:06.362208 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:06.492544 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:06.501160 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-2696f218-a529-452f-9551-a68417582719 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.152548 Oct 27 13:36:06.501732 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 569/1156] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:06 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:07.525001 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:07.525729 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:07.532496 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:07.532974 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:07.533403 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:07.534090 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:07.534535 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:07.534952 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:07.667222 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:07.675062 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-be5b6e2b-5467-4df9-bad4-049419d6d8bf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.154849 Oct 27 13:36:07.675622 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 588/1157] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:07 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:08.697760 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:08.698395 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:08.705385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:08.705864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:08.706283 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:08.706963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:08.707409 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:08.707820 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:08.840206 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:08.848480 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-981b0fa8-7afe-49d9-81ee-1855a3002a77 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.154598 Oct 27 13:36:08.849046 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 570/1158] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:08 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:09.871149 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:09.871764 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:09.879591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:09.880109 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:09.880583 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:09.881292 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:09.881747 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:09.882174 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:10.341848 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:10.350213 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-b6cddeaa-1310-4935-9f18-451909ceec8e tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.483195 Oct 27 13:36:10.350782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 589/1159] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:09 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:11.375121 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:11.375759 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:11.382201 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:11.382667 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:11.383093 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:11.383783 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:11.384250 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:11.384670 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:11.515622 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:11.523321 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-b3896c88-e9e2-41e9-98e3-0b3612ec624a tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1575 microversion: 2.1 time: 0.152334 Oct 27 13:36:11.523887 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 571/1160] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:11 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:12.546841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:36:12.547464 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:36:12.549910 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:36:12.555075 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:12.555558 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:12.555994 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:12.556745 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:12.557202 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:12.557629 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:12.685459 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:36:12.693103 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-edf0d856-f012-432e-bbef-63ea421b5439 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1562 microversion: 2.1 time: 0.150116 Oct 27 13:36:12.693670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 590/1161] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:36:12 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1562 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:36:13.773071 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "name": "network-vif-plugged", "status": "completed", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:36:13.778771 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=3 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:36:13.785982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:36:13.786472 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:36:13.786903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:36:13.798217 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] Creating event network-vif-plugged:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:36:13.804223 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-b0cc2bb3-dab5-4541-8ac7-4911d27be428 req-07971948-9fa7-41f0-b2ba-4b72a6d23476 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034716 Oct 27 13:36:13.804903 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 572/1162] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:37:26.879499 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_api:SELECT=1 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:37:26.880943 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG dbcounter [-] [118773] Writing DB stats nova_cell1:SELECT=22 {{(pid=118773) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:37:26.882557 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_cell1:SELECT=30 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:37:26.883836 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG dbcounter [-] [118774] Writing DB stats nova_api:SELECT=1 {{(pid=118774) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 27 13:37:26.886688 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:26.887268 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:26.890582 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:26.894579 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:26.895388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:26.895674 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:26.896670 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:26.897418 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:26.897771 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:26.902338 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:26.902806 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:26.903251 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:26.914385 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] Creating event network-changed:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:37:26.920272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-c54db8d2-5bc5-43ae-bad1-df558489333c req-8bb62b6c-b4ad-4513-8257-5582d1f11e5d service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040022 Oct 27 13:37:26.920879 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 573/1163] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:37:26.924989 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Going to try to terminate instance {{(pid=118773) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:37:27.015552 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-5d4a6dac-a09b-469c-9bca-e81845cfa9d1 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "DELETE /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 204 len: 0 microversion: 2.1 time: 0.134221 Oct 27 13:37:27.019270 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 591/1164] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:37:26 2022] DELETE /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:37:27.025094 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:27.025792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:27.032483 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:27.032970 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:27.033401 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:27.034099 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:27.034530 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:27.034946 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:27.173818 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:27.181907 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-aa217a5d-9cf5-4096-8b48-ccc960b33edf tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.161083 Oct 27 13:37:27.183398 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 574/1165] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:27 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:28.205770 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:28.206472 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:28.212873 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:28.213352 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:28.213784 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:28.214981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:28.215426 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:28.215843 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:28.376591 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:28.384492 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-211b04b0-8556-4b33-b2dc-0c6b105ebef4 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1568 microversion: 2.1 time: 0.182847 Oct 27 13:37:28.385057 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 592/1166] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:28 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1568 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:29.003203 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1", "name": "network-vif-deleted", "tag": "6f019989-3f7e-446f-a0f2-3b80e74ba6d9"}]} {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:29.013966 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:29.014439 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:29.014868 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:29.026162 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.compute.server_external_events [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] Creating event network-vif-deleted:6f019989-3f7e-446f-a0f2-3b80e74ba6d9 for instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 on hv-cinder-86243 Oct 27 13:37:29.031468 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [req-272cc7b6-fb73-4aae-870e-e086dcc4b312 req-46ceca37-ef32-41b6-999c-95b578e812e5 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Oct 27 13:37:29.032063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 575/1167] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:37:29.408801 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:29.409542 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:29.416557 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:29.417085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:29.417550 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:29.418250 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:29.418945 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:29.419525 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:29.455961 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:29.456479 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:29.456924 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:29.457576 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.objects.instance [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lazy-loading 'fault' on Instance uuid f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 {{(pid=118773) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:37:29.500978 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d5a8fcbaf9543aca96dea1ce9de3a46', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a470328245084347ac78821d1a0184f7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:29.509315 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-01ff47e3-2d3d-406e-bdbe-77a7c0c143d9 tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 200 len: 1224 microversion: 2.1 time: 0.104478 Oct 27 13:37:29.509922 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 593/1168] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:29 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 1224 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:30.534222 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:30.534947 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] [instance: f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:30.541019 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:30.541830 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:30.541934 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:30.542584 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:30.543030 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:30.543448 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:30.556471 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] HTTP exception thrown: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Request method failure captured: Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 HTTP/1.1 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWoiUAfYFynwpPz3SLFYV6eV2YkS6OH7d9-odJZp76WtvCE5qe6V8kOQh04aIsiYjbwC2sk37xbZ6oUECTidjySqsS4dtsqGM3Hcp3id1d-V9erbtPhqlMxNE0eLOZogIoQ7PkpuQ5L5sp8Fh3KBIIy80jC07eLpPLEIErZ3TWeRZsok Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: a470328245084347ac78821d1a0184f7 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-TestShelveInstance-750029156 Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:37:30.558714 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/a470328245084347ac78821d1a0184f7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a470328245084347ac78821d1a0184f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/a470328245084347ac78821d1a0184f7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_a470328245084347ac78821d1a0184f7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-TestShelveInstance-750029156 Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: a470328245084347ac78821d1a0184f7 Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-TestShelveInstance-750029156 Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-TestShelveInstance-750029156-project Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: 1d5a8fcbaf9543aca96dea1ce9de3a46 Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-TestShelveInstance-750029156-project Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. Oct 27 13:37:30.560491 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': 'f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1'} Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:37:30.561477 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. Oct 27 13:37:30.562864 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:30.564158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Returning 404 to user: Instance f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:37:30.564158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-517d520d-f89f-4065-9d23-3669fd98ecec tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1" status: 404 len: 111 microversion: 2.1 time: 0.030799 Oct 27 13:37:30.564158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 576/1169] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:30 2022] GET /compute/v2.1/servers/f35fdfcd-504d-4a78-9aa0-5b4ffb9070c1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:37:30.724482 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-0ad7ed2d-ae33-4ee9-8600-500accf8af3c tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] Calling method '.version_select at 0x7fb37323f5e0>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:30.752099 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-0ad7ed2d-ae33-4ee9-8600-500accf8af3c tempest-TestShelveInstance-750029156 tempest-TestShelveInstance-750029156-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2049120547" status: 202 len: 0 microversion: 2.1 time: 0.032370 Oct 27 13:37:30.752773 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 594/1170] 10.222.0.48 () {58 vars in 1254 bytes} [Thu Oct 27 13:37:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2049120547 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 27 13:37:39.137390 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bebfd790-14af-407c-9357-ce102a1ce53d", "tag": "348273cd-f10d-480b-b8b3-9e76b212a7c1"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:39.145004 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:39.145522 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:39.147957 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:39.148533 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:39.149036 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:39.152003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:39.152561 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:39.153000 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:39.153696 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:39.154324 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:39.154744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:39.160470 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] Creating event network-changed:348273cd-f10d-480b-b8b3-9e76b212a7c1 for instance bebfd790-14af-407c-9357-ce102a1ce53d on hv-cinder-86243 Oct 27 13:37:39.165892 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-196a80ab-0a9c-4303-868e-3e3b440f324c req-af51929f-b90e-4731-82bb-11129eddb333 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033109 Oct 27 13:37:39.166728 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 595/1171] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 27 13:37:39.182342 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:37:39.266982 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4d3437ae-f2bf-4d9b-a453-cc0894ca4244 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "DELETE /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 204 len: 0 microversion: 2.1 time: 0.137254 Oct 27 13:37:39.267910 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 577/1172] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:37:39 2022] DELETE /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:37:39.279653 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:39.281981 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:39.289379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:39.289864 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:39.290297 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:39.291284 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:39.291841 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:39.292372 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:39.460689 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:39.468432 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-26522a37-1316-423d-bbea-a1f2ac09d297 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1572 microversion: 2.1 time: 0.195606 Oct 27 13:37:39.469006 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 596/1173] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:39 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1572 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:40.491562 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:40.492435 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:40.499538 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:40.500020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:40.500488 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:40.501185 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:40.501638 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:40.502063 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:40.637092 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:40.644913 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-a21f3e3f-ce09-4b99-a471-c889cc089d1c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1572 microversion: 2.1 time: 0.157708 Oct 27 13:37:40.645473 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 578/1174] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:40 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1572 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:41.187778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bebfd790-14af-407c-9357-ce102a1ce53d", "name": "network-vif-deleted", "tag": "348273cd-f10d-480b-b8b3-9e76b212a7c1"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:41.198085 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:41.198644 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:41.199603 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:41.211498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] Creating event network-vif-deleted:348273cd-f10d-480b-b8b3-9e76b212a7c1 for instance bebfd790-14af-407c-9357-ce102a1ce53d on hv-cinder-86243 Oct 27 13:37:41.217092 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-88ddedf3-8f41-438b-8ade-8be60557baf1 req-ff2d4221-32e5-48ee-9170-b19428f9d56e service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033005 Oct 27 13:37:41.217795 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 597/1175] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:37:41.668040 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:41.668655 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:41.675009 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:41.675497 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:41.675932 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:41.676652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:41.677109 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:41.677535 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:41.708120 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:41.708568 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:41.709003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:41.709447 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lazy-loading 'fault' on Instance uuid bebfd790-14af-407c-9357-ce102a1ce53d {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:37:41.750146 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:41.758326 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-989ea8d9-8af7-4eba-9f1f-6cf462dd4b5a tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 200 len: 1229 microversion: 2.1 time: 0.093957 Oct 27 13:37:41.758652 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 579/1176] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:41 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 1229 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:42.783075 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:42.783778 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: bebfd790-14af-407c-9357-ce102a1ce53d] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:42.790037 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:42.790511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:42.790942 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:42.791621 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:42.792068 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:42.792519 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:42.805985 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] HTTP exception thrown: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Request method failure captured: Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d HTTP/1.1 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofuBNno0SwerIiV8UQfrz1XBCn_LlQey4V-RFEDLLW7P3On273Ec2eac9t3G3gk7GGjcP0hlX8SjgShrr0Uh1yjPKXEGsnI7ILGvbGrn2ONussnwTezbRSjcRonzo55PlN7yrIIu_zdrwbWO7XMnqnaggZbO6uHT25ru8hxf4oSN7k Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:37:42.807554 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a41fc97ca6ea4a1c8201f068b26e6888 Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. Oct 27 13:37:42.809926 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': 'bebfd790-14af-407c-9357-ce102a1ce53d'} Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:37:42.810932 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. Oct 27 13:37:42.812657 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:42.814129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Returning 404 to user: Instance bebfd790-14af-407c-9357-ce102a1ce53d could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:37:42.814129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-05683763-c020-4708-a556-936faf195b82 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d" status: 404 len: 111 microversion: 2.1 time: 0.031184 Oct 27 13:37:42.814129 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 598/1177] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:42 2022] GET /compute/v2.1/servers/bebfd790-14af-407c-9357-ce102a1ce53d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:37:45.849436 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:45.850074 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:45.852049 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12651cd4-4b20-496e-aa7e-a7c4bb660d60", "tag": "345f34ea-234b-441c-abfc-59215677d45d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:45.857140 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:45.857628 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:45.858060 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:45.859020 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:45.859718 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:45.860336 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:45.862875 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:45.863351 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:45.863781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:45.875733 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] Creating event network-changed:345f34ea-234b-441c-abfc-59215677d45d for instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 on hv-cinder-86243 Oct 27 13:37:45.881498 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-c54ee3f8-065b-49b5-86ea-6b41946dc210 req-abddd5b5-5e16-4289-a69e-12f3905da5e3 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033395 Oct 27 13:37:45.882088 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 599/1178] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:37:45.887668 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Going to try to terminate instance {{(pid=118774) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 27 13:37:45.973792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-773e61f7-6d57-4be7-a2b0-94842fe73e90 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "DELETE /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 204 len: 0 microversion: 2.1 time: 0.127947 Oct 27 13:37:45.974963 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 580/1179] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:37:45 2022] DELETE /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 27 13:37:45.986742 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:45.987787 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:45.994425 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:45.995003 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:45.995531 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:45.996379 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:45.996931 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:45.998177 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:46.157035 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.policy [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118773) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:46.165478 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-d8a36de5-b588-41b6-b9df-2dc8aa834f38 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1573 microversion: 2.1 time: 0.185592 Oct 27 13:37:46.166304 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 600/1180] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:45 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1573 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 27 13:37:47.190274 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:47.191081 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:47.197161 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:47.197635 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:47.198067 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:47.198749 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:47.199198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:47.199621 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:47.329792 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:47.337494 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-4a95aaea-7105-4c51-8039-35cb46f4353e tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1573 microversion: 2.1 time: 0.151453 Oct 27 13:37:47.338064 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 581/1181] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:47 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:47.907150 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12651cd4-4b20-496e-aa7e-a7c4bb660d60", "name": "network-vif-deleted", "tag": "345f34ea-234b-441c-abfc-59215677d45d"}]} {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 27 13:37:47.917601 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:47.918212 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:47.918643 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:47.931045 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.compute.server_external_events [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] Creating event network-vif-deleted:345f34ea-234b-441c-abfc-59215677d45d for instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 on hv-cinder-86243 Oct 27 13:37:47.935781 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [req-465806f1-7d30-41f5-951a-7d7601b8f36b req-b8812bc9-2118-4f39-8583-a5446cccb0e8 service nova] 10.222.0.48 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Oct 27 13:37:47.936388 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 601/1182] 10.222.0.48 () {64 vars in 1317 bytes} [Thu Oct 27 13:37:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 27 13:37:48.361100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:48.361728 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:48.368198 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:48.368715 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:48.369158 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:48.369848 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:48.370304 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:48.370731 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:48.401611 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:48.402088 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:48.402520 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:48.402964 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.objects.instance [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lazy-loading 'fault' on Instance uuid 12651cd4-4b20-496e-aa7e-a7c4bb660d60 {{(pid=118774) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 27 13:37:48.448003 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.policy [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a41fc97ca6ea4a1c8201f068b26e6888', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f291a3a8c0394e928aee758baa470ca7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118774) authorize /opt/stack/nova/nova/policy.py:199}} Oct 27 13:37:48.456536 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-5e17b57e-e759-471e-a417-30c554c978f6 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 200 len: 1228 microversion: 2.1 time: 0.099220 Oct 27 13:37:48.457100 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 582/1183] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:48 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 1228 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 27 13:37:49.481348 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:49.482091 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 12651cd4-4b20-496e-aa7e-a7c4bb660d60] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:49.488253 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.488748 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.489190 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:49.489886 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.490347 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.490777 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:49.504005 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] HTTP exception thrown: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Request method failure captured: Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 HTTP/1.1 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofuBNno0SwerIiV8UQfrz1XBCn_LlQey4V-RFEDLLW7P3On273Ec2eac9t3G3gk7GGjcP0hlX8SjgShrr0Uh1yjPKXEGsnI7ILGvbGrn2ONussnwTezbRSjcRonzo55PlN7yrIIu_zdrwbWO7XMnqnaggZbO6uHT25ru8hxf4oSN7k Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:37:49.505628 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a41fc97ca6ea4a1c8201f068b26e6888 Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. Oct 27 13:37:49.507331 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '12651cd4-4b20-496e-aa7e-a7c4bb660d60'} Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:37:49.508358 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. Oct 27 13:37:49.510278 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.511731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Returning 404 to user: Instance 12651cd4-4b20-496e-aa7e-a7c4bb660d60 could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:37:49.511731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ea76c031-2d34-4a7c-8540-d5aab4830512 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60" status: 404 len: 111 microversion: 2.1 time: 0.030519 Oct 27 13:37:49.511731 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 602/1184] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:49 2022] GET /compute/v2.1/servers/12651cd4-4b20-496e-aa7e-a7c4bb660d60 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:37:49.943512 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:49.944023 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.compute.api [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118774) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:49.951006 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.951475 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.951902 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:49.952606 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.953053 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.953469 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG oslo_concurrency.lockutils [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118774) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:49.968927 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.wsgi [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] HTTP exception thrown: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Request method failure captured: Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: request: DELETE /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f HTTP/1.1 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept: application/json Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Accept-Encoding: identity Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Connection: close Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Length: 0 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Content-Type: application/json Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Host: 10.222.0.48 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: Openstack-System-Scope: None Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: User-Agent: python-urllib3/1.26.12 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Auth-Token: gAAAAABjWofuBNno0SwerIiV8UQfrz1XBCn_LlQey4V-RFEDLLW7P3On273Ec2eac9t3G3gk7GGjcP0hlX8SjgShrr0Uh1yjPKXEGsnI7ILGvbGrn2ONussnwTezbRSjcRonzo55PlN7yrIIu_zdrwbWO7XMnqnaggZbO6uHT25ru8hxf4oSN7k Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Id: None Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Domain-Name: None Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Identity-Status: Confirmed Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Is-Admin-Project: True Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Id: default Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Domain-Name: Default Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Project-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Role: reader,member Oct 27 13:37:49.970540 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Roles: reader,member Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-Tenant-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Id: default Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Domain-Name: Default Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Id: a41fc97ca6ea4a1c8201f068b26e6888 Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: X-User-Name: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: method: > Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: exception: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:49.972272 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: action_args: {'id': '14588610-98fd-455b-9380-16dbcd733d9f'} Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:37:49.973346 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:49.974916 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: ERROR nova.api.openstack.wsgi Oct 27 13:37:49.976743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Returning 404 to user: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. {{(pid=118774) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:37:49.976743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-3d1d88ac-e5b9-4422-b697-42e9bd0e271c tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "DELETE /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 404 len: 111 microversion: 2.1 time: 0.032309 Oct 27 13:37:49.976743 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 583/1185] 10.222.0.48 () {58 vars in 1239 bytes} [Thu Oct 27 13:37:49 2022] DELETE /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:37:49.980493 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '>' {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:49.981115 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.compute.api [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] [instance: 14588610-98fd-455b-9380-16dbcd733d9f] Fetching instance by UUID {{(pid=118773) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 27 13:37:49.987511 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.988007 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.988618 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:49.989321 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Acquiring lock "ce8722d1-aebc-456c-be32-911a0277d16a" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 27 13:37:49.989782 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 27 13:37:49.990214 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG oslo_concurrency.lockutils [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Lock "ce8722d1-aebc-456c-be32-911a0277d16a" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118773) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 27 13:37:50.003652 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.wsgi [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] HTTP exception thrown: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Request method failure captured: Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: request: GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f HTTP/1.1 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept: application/json Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Accept-Encoding: identity Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Connection: close Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Length: 0 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Content-Type: application/json Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Host: 10.222.0.48 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: Openstack-System-Scope: None Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: User-Agent: python-urllib3/1.26.12 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Auth-Token: gAAAAABjWofuBNno0SwerIiV8UQfrz1XBCn_LlQey4V-RFEDLLW7P3On273Ec2eac9t3G3gk7GGjcP0hlX8SjgShrr0Uh1yjPKXEGsnI7ILGvbGrn2ONussnwTezbRSjcRonzo55PlN7yrIIu_zdrwbWO7XMnqnaggZbO6uHT25ru8hxf4oSN7k Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Id: None Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Domain-Name: None Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Identity-Status: Confirmed Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Is-Admin-Project: True Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Id: default Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Domain-Name: Default Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Project-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Role: reader,member Oct 27 13:37:50.005216 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Roles: reader,member Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Service-Catalog: [{"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/compute/v2/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/volume/v3/f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.48:8080", "publicURL": "http://10.222.0.48:8080/v1/AUTH_f291a3a8c0394e928aee758baa470ca7"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.48/identity"}]}] Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Id: f291a3a8c0394e928aee758baa470ca7 Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-Tenant-Name: tempest-TestVolumeBootPattern-1543394447 Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Id: default Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Domain-Name: Default Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Id: a41fc97ca6ea4a1c8201f068b26e6888 Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: X-User-Name: tempest-TestVolumeBootPattern-1543394447-project Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: method: > Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: exception: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:50.006904 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: action_args: {'id': '14588610-98fd-455b-9380-16dbcd733d9f'} Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: {{(pid=118773) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 27 13:37:50.007849 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. Oct 27 13:37:50.009489 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: ERROR nova.api.openstack.wsgi Oct 27 13:37:50.011206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: DEBUG nova.api.openstack.wsgi [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Returning 404 to user: Instance 14588610-98fd-455b-9380-16dbcd733d9f could not be found. {{(pid=118773) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 27 13:37:50.011206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: INFO nova.api.openstack.requestlog [None req-ff2cf846-74a8-46fe-9dc7-acd32875d8fb tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f" status: 404 len: 111 microversion: 2.1 time: 0.030006 Oct 27 13:37:50.011206 dv-cinder-862432-3-iscsi devstack@n-api.service[118773]: [pid: 118773|app: 0|req: 603/1186] 10.222.0.48 () {58 vars in 1236 bytes} [Thu Oct 27 13:37:49 2022] GET /compute/v2.1/servers/14588610-98fd-455b-9380-16dbcd733d9f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 27 13:37:51.297378 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: DEBUG nova.api.openstack.wsgi [None req-6c611790-d652-4fa8-93bf-8e677b840e14 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] Calling method '.version_select at 0x7fb3735f9040>' {{(pid=118774) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 27 13:37:51.322270 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: INFO nova.api.openstack.requestlog [None req-6c611790-d652-4fa8-93bf-8e677b840e14 tempest-TestVolumeBootPattern-1543394447 tempest-TestVolumeBootPattern-1543394447-project] 10.222.0.48 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-936264149" status: 202 len: 0 microversion: 2.1 time: 0.029196 Oct 27 13:37:51.322744 dv-cinder-862432-3-iscsi devstack@n-api.service[118774]: [pid: 118774|app: 0|req: 584/1187] 10.222.0.48 () {58 vars in 1260 bytes} [Thu Oct 27 13:37:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-936264149 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)